Uses of Interface
eus.ixa.ixa.pipe.ml.tok.Tokenizer

Packages that use Tokenizer

Package	Description
eus.ixa.ixa.pipe.ml.tok	Package containing the Sentence Segmenter and Tokenizer classes.

Uses of Tokenizer in eus.ixa.ixa.pipe.ml.tok

Classes in eus.ixa.ixa.pipe.ml.tok that implement Tokenizer

Modifier and Type	Class and Description
class	RuleBasedTokenizer This class provides a multilingual rule based tokenizer.