eus.ixa.ixa.pipe.ml.lemma

Class DictionaryLemmatizer

java.lang.Object

eus.ixa.ixa.pipe.ml.lemma.DictionaryLemmatizer

All Implemented Interfaces:

opennlp.tools.util.model.SerializableArtifact

public class DictionaryLemmatizer
extends Object
implements opennlp.tools.util.model.SerializableArtifact

Lemmatize by simple dictionary lookup into a serialized hashmap built from a file containing, for each line, word\tablemma\tabpostag.

Version:

2016-07-19

Author:

ragerri

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DictionaryLemmatizer.DictionaryLemmatizerSerializer

Constructor Summary

Constructors

Constructor and Description
DictionaryLemmatizer(InputStream in) Construct a hashmap from the input tab separated dictionary.

Method Summary

Modifier and Type	Method and Description
String	apply(String word, String postag) Lookup lemma in a dictionary.
Class<?>	getArtifactSerializerClass()
Map<List<String>,String>	getDictMap() Get the Map containing the dictionary.
List<String>	lemmatize(String[] tokens, Span[] postags)
void	serialize(OutputStream out)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DictionaryLemmatizer

public DictionaryLemmatizer(InputStream in)
                     throws IOException

Construct a hashmap from the input tab separated dictionary. The input file should have, for each line, word\tablemma\tabpostag

Parameters:

in - the input dictionary via inputstream

Throws:

IOException - if io problems

Method Detail

getDictMap

public Map<List<String>,String> getDictMap()

Get the Map containing the dictionary.

Returns:

dictMap the Map

lemmatize

public List<String> lemmatize(String[] tokens,
                              Span[] postags)

apply

public String apply(String word,
                    String postag)

Lookup lemma in a dictionary. Outputs "O" if not found.

Parameters:

word - the token

postag - the postag

Returns:

the lemma

serialize

public void serialize(OutputStream out)
               throws IOException

Throws:

IOException

getArtifactSerializerClass

public Class<?> getArtifactSerializerClass()

Specified by:

getArtifactSerializerClass in interface opennlp.tools.util.model.SerializableArtifact