public class TokenComponents extends Object
| Constructor and Description |
|---|
TokenComponents() |
| Modifier and Type | Method and Description |
|---|---|
static AnalysisEngineDescription |
createPennTokenizer() |
static AnalysisEngineDescription |
createSubtokenizer() |
public TokenComponents()
public static AnalysisEngineDescription createPennTokenizer() throws ResourceInitializationException
ResourceInitializationExceptionpublic static AnalysisEngineDescription createSubtokenizer() throws ResourceInitializationException
ResourceInitializationExceptionCopyright © 2014. All rights reserved.