eus.ixa.ixa.pipe.tok

Class FMeasure

java.lang.Object

eus.ixa.ixa.pipe.tok.FMeasure

public final class FMeasure
extends Object

Evaluation results are the arithmetic mean of the precision scores calculated for each reference sample and the arithmetic mean of the recall scores calculated for each reference sample. This class is specified for the Tokenizer evaluation which looks at the Token value and the index in the list of Tokens. This class is largely the same as the FMeasure class in Apache OpenNLP project with some very minor modifications.

Constructor Summary

Constructors

Constructor and Description
FMeasure()

Method Summary

Modifier and Type	Method and Description
double	getFMeasure() Retrieves the f-measure score.
double	getPrecisionScore() Retrieves the arithmetic mean of the precision scores calculated for each evaluated sample.
double	getRecallScore() Retrieves the arithmetic mean of the recall score calculated for each evaluated sample.
void	mergeInto(FMeasure measure)
static double	precision(List<List<String>> references, List<List<String>> predictions) Calculates the precision score for the given reference and predicted spans.
static double	recall(List<List<String>> references, List<List<String>> predictions) Calculates the recall score for the given reference and predicted spans.
String	toString() Creates a human read-able String representation.
void	updateScores(List<List<String>> references, List<List<String>> predictions)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FMeasure

public FMeasure()

Method Detail

getPrecisionScore

public double getPrecisionScore()

Retrieves the arithmetic mean of the precision scores calculated for each evaluated sample.

Returns:

the arithmetic mean of all precision scores

getRecallScore

public double getRecallScore()

Retrieves the arithmetic mean of the recall score calculated for each evaluated sample.

Returns:

the arithmetic mean of all recall scores

getFMeasure

public double getFMeasure()

Retrieves the f-measure score. f-measure = 2 * precision * recall / (precision + recall)

Returns:

the f-measure or -1 if precision + recall is less or equal to 0

updateScores

public void updateScores(List<List<String>> references,
                         List<List<String>> predictions)

mergeInto

public void mergeInto(FMeasure measure)

toString

public String toString()

Creates a human read-able String representation.

Overrides:

toString in class Object

precision

public static double precision(List<List<String>> references,
                               List<List<String>> predictions)

Calculates the precision score for the given reference and predicted spans.

Parameters:

references - the gold standard spans

predictions - the predicted spans

Returns:

the precision score or NaN if there are no predicted spans

recall

public static double recall(List<List<String>> references,
                            List<List<String>> predictions)

Calculates the recall score for the given reference and predicted spans.

Parameters:

references - the gold standard spans

predictions - the predicted spans

Returns:

the recall score or NaN if there are no reference spans