| Class | Description |
|---|---|
| CaseInsensitiveNoSemiColonAnalyzer | |
| CaseInsensitiveWhitespaceAnalyzer | |
| CaseSensitiveAllTokenAnalyzer |
all tokens are token characters
|
| CaseSensitiveNoSemiColonAnalyzer | |
| NoSemiColonTokenizer |
For this tokenizer "; " or ";" are token separators, and therefore no token characters.
|
| NoSeparatorTokenizer |
For this tokenizer every character is a tokenChar
|
Copyright © 2020 Fryske Akademy. All rights reserved.