edu.nyu.jet.lex

Class Stemmer

java.lang.Object

edu.nyu.jet.lex.Stemmer

public class Stemmer
extends Object

Stemmer provides method for getting stem of word.

Stemmer uses stem dictionary which written in plain text. Each line of stem dictionary will be as following

  do    did does doing done
 

Each word is separated by whitepsace characters. First word is stem and other words are inflected word.

Author:

Akira ODA

Constructor Summary

Constructors

Constructor and Description
Stemmer()

Method Summary

Methods

Modifier and Type	Method and Description
static Stemmer	getDefaultStemmer() Returns default stemmer.
String	getStem(String word, String pos) Returns stem of word
void	loadDictionary(File file) Loads stem dictonary.
void	loadDictionary(Reader reader)
void	tagStem(Document doc, Span span) Added stem feature to each token annotation if token text and stem are difference.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Stemmer

public Stemmer()

Method Detail

getDefaultStemmer

public static Stemmer getDefaultStemmer()

Returns default stemmer.

Returns:

loadDictionary

public void loadDictionary(File file)
                    throws IOException

Loads stem dictonary.

Parameters:

file -

Throws:

IOException

loadDictionary

public void loadDictionary(Reader reader)
                    throws IOException

Throws:

IOException

tagStem

public void tagStem(Document doc,
           Span span)

Added stem feature to each token annotation if token text and stem are difference.

Parameters:

doc -

span -

getStem

public String getStem(String word,
             String pos)

Returns stem of word

Parameters:

word -

pos - part of speech of word

Returns:

stem of word.