eus.ixa.ixa.pipe.lemma

Class MultiWordMatcher

java.lang.Object

eus.ixa.ixa.pipe.lemma.MultiWordMatcher

public class MultiWordMatcher
extends Object

Reads a dictionary multiword\tmultiwordlemma\tpostag\tambiguity and matches the multiwords for each sentence.

Version:

2015-01-28

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
MultiWordMatcher(Properties props) Construct a multiword matcher with a dictionary for a given language.

Method Summary

Modifier and Type	Method and Description
int	getMaxTokenCount() Get the key,value size of the dictionary.
String[]	getTokensWithMultiWords(String[] tokens) Get input text and join the multiwords found in the dictionary object.
opennlp.tools.util.Span[]	multiWordsToSpans(String[] tokens) Detects multiword expressions ignoring case.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiWordMatcher

public MultiWordMatcher(Properties props)
                 throws IOException

Construct a multiword matcher with a dictionary for a given language.

Parameters:

props - the properties options

Throws:

IOException - throw exception is files does not exist

Method Detail

getTokensWithMultiWords

public final String[] getTokensWithMultiWords(String[] tokens)

Get input text and join the multiwords found in the dictionary object.

Parameters:

tokens - the input text

Returns:

the output text with the joined multiwords

multiWordsToSpans

public final opennlp.tools.util.Span[] multiWordsToSpans(String[] tokens)

Detects multiword expressions ignoring case.

Parameters:

tokens - the tokenized sentence

Returns:

spans of the multiword

getMaxTokenCount

public int getMaxTokenCount()

Get the key,value size of the dictionary.

Returns:

maximum token count in the dictionary