eus.ixa.ixa.pipe.tok

Class Annotate

java.lang.Object

eus.ixa.ixa.pipe.tok.Annotate

public class Annotate
extends Object

This class provides the annotation functions to output the tokenized text into:

1. A list of WF elements inside a NAF document (DEFAULT)
2. As running tokenized and segmented text
3. CoNLL format, namely, one token per line and two newlines for each sentence.
4. Evaluate the tokenizer against a reference text.

All these options are configurable by using the --nokaf boolean parameter and the -outputFormat parameter of the CLI.

Version:

2015-04-08

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
Annotate(BufferedReader breader, Properties properties)

Method Summary

Methods

Modifier and Type	Method and Description
String	tokenizeToCoNLL() Tokenizes and segments input text.
String	tokenizeToCoNLLOffsets() Tokenizes and segments input text.
void	tokenizeToKAF(ixa.kaflib.KAFDocument kaf)
String	tokenizeToText() Tokenize and Segment input text.
static void	tokensToKAF(Reader breader, ixa.kaflib.KAFDocument kaf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Annotate

public Annotate(BufferedReader breader,
        Properties properties)

Method Detail

tokenizeToKAF

public void tokenizeToKAF(ixa.kaflib.KAFDocument kaf)
                   throws IOException

Throws:

IOException

tokenizeToCoNLL

public String tokenizeToCoNLL()

Tokenizes and segments input text. Outputs tokenized text in conll format: one token per sentence and two newlines to divide sentences.

Returns:

String tokenized text

tokenizeToCoNLLOffsets

public String tokenizeToCoNLLOffsets()

Tokenizes and segments input text. Outputs tokenized text in conll format: one token per sentence and two newlines to divide sentences plus offsets and lenght information about tokens.

Returns:

String tokenized text

tokenizeToText

public String tokenizeToText()

Tokenize and Segment input text. Outputs tokens in running text format one sentence per line.

Returns:

String tokenized text

tokensToKAF

public static void tokensToKAF(Reader breader,
               ixa.kaflib.KAFDocument kaf)
                        throws IOException

Throws:

IOException