| Package | Description |
|---|---|
| se.lth.cs.srl.languages | |
| se.lth.cs.srl.preprocessor | |
| se.lth.cs.srl.preprocessor.tokenization |
| Modifier and Type | Method and Description |
|---|---|
Tokenizer |
Language.getTokenizer(File tokenModelFile) |
| Modifier and Type | Field and Description |
|---|---|
protected Tokenizer |
Preprocessor.tokenizer |
| Constructor and Description |
|---|
Preprocessor(Tokenizer tokenizer,
is2.lemmatizer.Lemmatizer lemmatizer,
is2.tag.Tagger tagger,
is2.mtag.Tagger mtagger,
is2.parser.Parser parser) |
| Modifier and Type | Class and Description |
|---|---|
class |
ExnerSwedishTokenizer |
class |
OpenNLPToolsTokenizerWrapper |
class |
StanfordChineseSegmenterWrapper
This is a wrapper for the Stanford Chinese Segmenter, version 3.2.0
|
class |
StanfordFrenchTokenizer |
class |
StanfordPTBTokenizer |
class |
WhiteSpaceTokenizer |
Copyright © 2016. All rights reserved.