edu.nyu.jet.refres

Class PronounScorer

java.lang.Object

edu.nyu.jet.refres.DocumentScorer

edu.nyu.jet.refres.PronounScorer

public class PronounScorer
extends DocumentScorer

implements a simple pronoun accuracy metric. For each third-person pronoun (including possessive and reflexives) in the response document which appears as a mention in the key, determine whether the antecedent (the most recent prior mention in the document) is correct (the same as the antecedent in the key).

Mentions in the response and key files are aligned based on the final character of the head of the mentions.

Field Summary

Fields

Modifier and Type	Field and Description
float	accuracy pronoun coreference accuracy for the most recently processed document.
float	overallAccuracy pronoun coreference accuracy for all documents processed by this instance of CorefScorer.

Constructor Summary

Constructors

Constructor and Description
PronounScorer() create a new pronoun coreference scorer.

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args)
void	report() writes to standard output a report on the most recently scored document.
void	score(Document responseDoc, Document keyDoc) compare the two documents, responseDoc and keyDoc, setting accuracy and overallAccuracy.
void	summary() writes to standard output a report on the overall accuracy for all documents processed so far.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

accuracy

public float accuracy

pronoun coreference accuracy for the most recently processed document.

overallAccuracy

public float overallAccuracy

pronoun coreference accuracy for all documents processed by this instance of CorefScorer.

Constructor Detail

PronounScorer

public PronounScorer()

create a new pronoun coreference scorer.

Method Detail

score

public void score(Document responseDoc,
         Document keyDoc)

compare the two documents, responseDoc and keyDoc, setting accuracy and overallAccuracy.

Specified by:

score in class DocumentScorer

report

public void report()

writes to standard output a report on the most recently scored document.

Specified by:

report in class DocumentScorer

summary

public void summary()

writes to standard output a report on the overall accuracy for all documents processed so far.

Specified by:

summary in class DocumentScorer

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException