eus.ixa.ixa.pipe.ml.lemma

Class MorfologikLemmatizer

java.lang.Object

eus.ixa.ixa.pipe.ml.lemma.MorfologikLemmatizer

public class MorfologikLemmatizer
extends Object

Lemmatizer based on Morfologik Stemming library. It requires a FSA Morfologik dictionary as input.

Version:

2014-07-08

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
MorfologikLemmatizer(URL dictURL) Reads a dictionary in morfologik FSA format.

Method Summary

Modifier and Type	Method and Description
String	apply(String word, String postag) Looks-up the lemma in a dictionary.
void	getAllPosLemmas(String word, List<String> posLemmaValues)
String[]	lemmatize(String[] tokens, String[] postags)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MorfologikLemmatizer

public MorfologikLemmatizer(URL dictURL)
                     throws IOException

Reads a dictionary in morfologik FSA format.

Parameters:

dictURL - the URL containing the dictionary the language

Throws:

IllegalArgumentException - if an exception is illegal

IOException - throws an exception if dictionary path is not correct

Method Detail

getAllPosLemmas

public final void getAllPosLemmas(String word,
                                  List<String> posLemmaValues)

lemmatize

public String[] lemmatize(String[] tokens,
                          String[] postags)

apply

public String apply(String word,
                    String postag)

Looks-up the lemma in a dictionary. Outputs "O" if not found.

Parameters:

word - the token

postag - the postag

Returns:

the lemma