edu.nyu.jet.hmm

Class LineByLineNameTagger

java.lang.Object

edu.nyu.jet.hmm.LineByLineNameTagger

public class LineByLineNameTagger
extends Object

reads a series of files, with each file containing one sentence per line, and writes out the sentences with named entity tags. Developed to handle MT training data.

Constructor Summary

Constructors

Constructor and Description
LineByLineNameTagger()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args) generate sentence list files for a list of documents.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineByLineNameTagger

public LineByLineNameTagger()

Method Detail

main

public static void main(String[] args)
                 throws IOException

generate sentence list files for a list of documents. Takes 4 command line parameters:
filelist: a list of the files to be processed
dataDir: the path of the directory containing the document
outputDir: the path of the directory to contain the output
For each file in filelist, the document is read from dataDir/file; if the input file has no sentence tags, the sentence splitter is invoked to add sentence tags; and then the sentence file is written to outputDir/file.sent .

Throws:

IOException