eus.ixa.ixa.pipe.lemma.dict

Class MorfologikLemmatizer

java.lang.Object

eus.ixa.ixa.pipe.lemma.dict.MorfologikLemmatizer

All Implemented Interfaces:

Lemmatizer

public class MorfologikLemmatizer
extends Object
implements Lemmatizer

Lemmatizer based on Morfologik Stemming library. It requires a FSA Morfologik dictionary as input.

Version:

2014-07-08

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
MorfologikLemmatizer(URL dictURL) Reads a dictionary in morfologik FSA format.

Method Summary

Modifier and Type	Method and Description
String	apply(String word, String postag) Looks-up the lemma in a dictionary.
String[]	lemmatize(String[] tokens, String[] postags) Generates lemma tags for the word and postag returning the result in an array.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MorfologikLemmatizer

public MorfologikLemmatizer(URL dictURL)
                     throws IOException

Reads a dictionary in morfologik FSA format.

Parameters:

dictURL - the URL containing the dictionary the language

Throws:

IllegalArgumentException - if an exception is illegal

IOException - throws an exception if dictionary path is not correct

Method Detail

lemmatize

public String[] lemmatize(String[] tokens,
                          String[] postags)

Description copied from interface: Lemmatizer

Generates lemma tags for the word and postag returning the result in an array.

Specified by:

lemmatize in interface Lemmatizer

Parameters:

tokens - an array of the tokens

postags - an array of the pos tags

Returns:

an array of lemma classes for each token in the sequence.

apply

public String apply(String word,
                    String postag)

Looks-up the lemma in a dictionary. Outputs "O" if not found.

Parameters:

word - the token

postag - the postag

Returns:

the lemma