Tokenizer (ClearTK TimeML 2.0.0 API)

java.lang.Object
- org.cleartk.opennlp.tools.Tokenizer

```
@Beta
public class Tokenizer
extends Object
```
An OpenNLP Tokenizer that uses the ClearTK type system.
Copyright (c) 2012, Regents of the University of Colorado
All rights reserved.

Author:

Steven Bethard

- Constructor Summary
  
  Constructors
  Constructor and Description
  
  Tokenizer()
- Method Summary
  
  Methods
  Modifier and Type Method and Description
  
  static AnalysisEngineDescription getDescription(String languageCode)
  - Methods inherited from class java.lang.Object
    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructors
Constructor and Description
`Tokenizer()`

Methods
Modifier and Type	Method and Description
`static AnalysisEngineDescription`	`getDescription(String languageCode)`

Constructor Detail
- Tokenizer
```
public Tokenizer()
```

Method Detail

getDescription

public static AnalysisEngineDescription getDescription(String languageCode)
                                                throws ResourceInitializationException

Throws:: ResourceInitializationException

Class Tokenizer

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

Tokenizer

Method Detail

getDescription