edu.nyu.jet.ne

Class TrieDictionary

java.lang.Object

edu.nyu.jet.ne.Dictionary

edu.nyu.jet.ne.TrieDictionary

public class TrieDictionary
extends Dictionary

An implementation of the Dictionary used by the Extended Named Entity annotator, based on an in-memory Trie plus an on-disk data base.

Author:

Akira ODA

Nested Class Summary

Nested classes/interfaces inherited from class edu.nyu.jet.ne.Dictionary

Dictionary.Entry

Constructor Summary

Constructors

Constructor and Description
TrieDictionary(File trieFile, File cdbFile)
TrieDictionary(String trieFilename, String cdbFilename)

Method Summary

Methods

Modifier and Type	Method and Description
Dictionary.Entry	lookup(int pos) look for a dictionary entry matching the token sequence beginning at token pos.
void	lookupStart(String[] tokens) initializes the dictionary look-up process for the text consisting of tokens tokens.
static void	main(String[] args)
static void	prepare(String dictFilename, String encoding, String trieFilename, String cdbFilename)
static String	readText(String filename, String encoding)
static void	testDict(String text, String trieFilename, String cdbFilename)

Methods inherited from class edu.nyu.jet.ne.Dictionary

lookup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TrieDictionary

public TrieDictionary(File trieFile,
              File cdbFile)
               throws IOException

Throws:

IOException

TrieDictionary

public TrieDictionary(String trieFilename,
              String cdbFilename)
               throws IOException

Throws:

IOException

Method Detail

lookupStart

public void lookupStart(String[] tokens)

initializes the dictionary look-up process for the text consisting of tokens tokens.

Specified by:

lookupStart in class Dictionary

lookup

public Dictionary.Entry lookup(int pos)

look for a dictionary entry matching the token sequence beginning at token pos.

Specified by:

lookup in class Dictionary

Parameters:

pos - the position within the token array passed to lookupStart

Returns:

the longest dictionary entry matching the token sequence, or null if no entry matches

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException

readText

public static String readText(String filename,
              String encoding)
                       throws IOException

Throws:

IOException

prepare

public static void prepare(String dictFilename,
           String encoding,
           String trieFilename,
           String cdbFilename)
                    throws IOException

Throws:

IOException

testDict

public static void testDict(String text,
            String trieFilename,
            String cdbFilename)
                     throws IOException

Throws:

IOException