Package org.fryske_akademy.exist.lucene
Class NoSemiColonTokenizer
java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.apache.lucene.analysis.util.CharTokenizer
org.fryske_akademy.exist.lucene.NoSemiColonTokenizer
- All Implemented Interfaces:
Closeable,AutoCloseable
public class NoSemiColonTokenizer
extends org.apache.lucene.analysis.util.CharTokenizer
For this tokenizer "; " or ";" are token separators, and therefore no token characters.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
org.apache.lucene.util.AttributeSource.State -
Field Summary
Fields inherited from class org.apache.lucene.analysis.Tokenizer
inputFields inherited from class org.apache.lucene.analysis.TokenStream
DEFAULT_TOKEN_ATTRIBUTE_FACTORYFields inherited from class org.apache.lucene.util.AttributeSource
DEFAULT_ATTRIBUTE_FACTORY -
Constructor Summary
ConstructorsConstructorDescriptionNoSemiColonTokenizer(Reader input) NoSemiColonTokenizer(org.apache.lucene.util.AttributeFactory factory, Reader input) -
Method Summary
Methods inherited from class org.apache.lucene.analysis.util.CharTokenizer
end, incrementToken, normalize, resetMethods inherited from class org.apache.lucene.analysis.Tokenizer
close, correctOffset, setReaderMethods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
-
Constructor Details
-
NoSemiColonTokenizer
-
NoSemiColonTokenizer
-
-
Method Details
-
isTokenChar
protected boolean isTokenChar(int c) - Specified by:
isTokenCharin classorg.apache.lucene.analysis.util.CharTokenizer
-