org.cleartk.clearnlp

Class Tokenizer

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasAnnotator_ImplBase

org.cleartk.clearnlp.Tokenizer_ImplBase<Token,Sentence>

org.cleartk.clearnlp.Tokenizer

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

public class Tokenizer
extends Tokenizer_ImplBase<Token,Sentence>

Field Summary

Fields inherited from class org.cleartk.clearnlp.Tokenizer_ImplBase

PARAM_LANGUAGE_CODE, PARAM_SEGMENT_SENTENCES, PARAM_WINDOW_CLASS

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getDescription()
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getDescription(String languageCode)
protected SentenceOps<Sentence>	getSentenceOps()
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getSentenceSegmenterAndTokenizerDescription(String languageCode)
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getTokenizerDescription(String languageCode)
protected TokenOps<Token>	getTokenOps()
void	initialize(org.apache.uima.UimaContext context)

Methods inherited from class org.cleartk.clearnlp.Tokenizer_ImplBase

process

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getLogger, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

initialize

public void initialize(org.apache.uima.UimaContext context)
                throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

initialize in class Tokenizer_ImplBase<Token,Sentence>

Throws:

org.apache.uima.resource.ResourceInitializationException

getDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getDescription()
                                                                                throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException

getTokenizerDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getTokenizerDescription(String languageCode)
                                                                                         throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException

getSentenceSegmenterAndTokenizerDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getSentenceSegmenterAndTokenizerDescription(String languageCode)
                                                                                                             throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException

getDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getDescription(String languageCode)
                                                                                throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException

getTokenOps

protected TokenOps<Token> getTokenOps()

Specified by:

getTokenOps in class Tokenizer_ImplBase<Token,Sentence>

getSentenceOps

protected SentenceOps<Sentence> getSentenceOps()

Specified by:

getSentenceOps in class Tokenizer_ImplBase<Token,Sentence>