public class TokenizerEvaluator extends Object
TokenizerEvaluator measures the performance of a tokenizer wrt to
some reference Tokens.| Modifier and Type | Field and Description |
|---|---|
static boolean |
DEBUG |
| Constructor and Description |
|---|
TokenizerEvaluator() |
| Modifier and Type | Method and Description |
|---|---|
void |
evaluate(List<Token> referenceList,
List<Token> predictedList)
Evaluates the given reference Token list wrt to the predicted Token list.
|
FMeasure |
getFMeasure() |
public static final boolean DEBUG
public void evaluate(List<Token> referenceList, List<Token> predictedList)
referenceList - the reference sample.predictedList - the predictedListpublic FMeasure getFMeasure()
Copyright © 2015 IXA pipes. All rights reserved.