eus.ixa.ixa.pipe.lemma

Class LemmatizerME

java.lang.Object

eus.ixa.ixa.pipe.lemma.LemmatizerME

All Implemented Interfaces:

Lemmatizer

public class LemmatizerME
extends Object
implements Lemmatizer

A probabilistic lemmatizer. Tries to predict the induced permutation class for each word depending on its surrounding context. Based on Grzegorz Chrupała. 2008. Towards a Machine-Learning Architecture for Lexical Functional Grammar Parsing. PhD dissertation, Dublin City University. http://grzegorz.chrupala.me/papers/phd-single.pdf

Field Summary

Fields

Modifier and Type	Field and Description
protected int	beamSize
static int	DEFAULT_BEAM_SIZE

Constructor Summary

Constructors

Constructor and Description
LemmatizerME(LemmatizerModel model) Initializes the current instance with the provided model and the default beam size of 3.

Method Summary

Modifier and Type	Method and Description
String[]	decodeLemmas(String[] toks, String[] preds) Decodes the lemma from the word and the induced lemma class.
String[]	lemmatize(String[] toks, String[] tags) Generates lemma tags for the word and postag returning the result in an array.
double[]	probs() Returns an array with the probabilities of the last decoded sequence.
void	probs(double[] probs) Populates the specified array with the probabilities of the last decoded sequence.
opennlp.tools.util.Sequence[]	topKLemmaClasses(String[] sentence, String[] tags)
opennlp.tools.util.Sequence[]	topKLemmaClasses(String[] sentence, String[] tags, double minSequenceScore)
opennlp.tools.util.Sequence[]	topKSequences(String[] sentence, String[] tags)
opennlp.tools.util.Sequence[]	topKSequences(String[] sentence, String[] tags, double minSequenceScore)
static LemmatizerModel	train(String languageCode, opennlp.tools.util.ObjectStream<LemmaSample> samples, opennlp.tools.util.TrainingParameters trainParams, LemmatizerFactory posFactory)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_BEAM_SIZE

public static final int DEFAULT_BEAM_SIZE

See Also:

Constant Field Values

beamSize

protected int beamSize

Constructor Detail

LemmatizerME

public LemmatizerME(LemmatizerModel model)

Initializes the current instance with the provided model and the default beam size of 3.

Parameters:

model - the model

Method Detail

lemmatize

public String[] lemmatize(String[] toks,
                          String[] tags)

Description copied from interface: Lemmatizer

Generates lemma tags for the word and postag returning the result in an array.

Specified by:

lemmatize in interface Lemmatizer

Parameters:

toks - an array of the tokens

tags - an array of the pos tags

Returns:

an array of lemma classes for each token in the sequence.

decodeLemmas

public String[] decodeLemmas(String[] toks,
                             String[] preds)

Decodes the lemma from the word and the induced lemma class.

Parameters:

toks - the array of tokens

preds - the predicted lemma classes

Returns:

the array of decoded lemmas

topKSequences

public opennlp.tools.util.Sequence[] topKSequences(String[] sentence,
                                                   String[] tags)

topKSequences

public opennlp.tools.util.Sequence[] topKSequences(String[] sentence,
                                                   String[] tags,
                                                   double minSequenceScore)

probs

public void probs(double[] probs)

Populates the specified array with the probabilities of the last decoded sequence. The sequence was determined based on the previous call to lemmatize. The specified array should be at least as large as the number of tokens in the previous call to lemmatize.

Parameters:

probs - An array used to hold the probabilities of the last decoded sequence.

probs

public double[] probs()

Returns an array with the probabilities of the last decoded sequence. The sequence was determined based on the previous call to chunk.

Returns:

An array with the same number of probabilities as tokens were sent to chunk when it was last called.

train

public static LemmatizerModel train(String languageCode,
                                    opennlp.tools.util.ObjectStream<LemmaSample> samples,
                                    opennlp.tools.util.TrainingParameters trainParams,
                                    LemmatizerFactory posFactory)
                             throws IOException

Throws:

IOException

topKLemmaClasses

public opennlp.tools.util.Sequence[] topKLemmaClasses(String[] sentence,
                                                      String[] tags)

topKLemmaClasses

public opennlp.tools.util.Sequence[] topKLemmaClasses(String[] sentence,
                                                      String[] tags,
                                                      double minSequenceScore)