eus.ixa.ixa.pipe.ml.pos

Class MultiWordMatcher

java.lang.Object

eus.ixa.ixa.pipe.ml.pos.MultiWordMatcher

public class MultiWordMatcher
extends Object

Reads a dictionary multiword\tmultiwordlemma\tpostag\tambiguity and matches the multiwords for each sentence.

Version:

2016-04-20

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
MultiWordMatcher(InputStream dictInputStream) Construct a multiword dictionary matcher.

Method Summary

Modifier and Type	Method and Description
int	getMaxTokenCount() Get the key,value size of the dictionary.
String[]	getTokensWithMultiWords(String[] tokens) Get input text and join the multiwords found in the dictionary object.
Span[]	multiWordsToSpans(String[] tokens) Detects multiword expressions ignoring case.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiWordMatcher

public MultiWordMatcher(InputStream dictInputStream)
                 throws IOException

Construct a multiword dictionary matcher.

Parameters:

dictInputStream - the dictionary

Throws:

IOException - if io problems

Method Detail

getTokensWithMultiWords

public final String[] getTokensWithMultiWords(String[] tokens)

Get input text and join the multiwords found in the dictionary object.

Parameters:

tokens - the input text

Returns:

the output text with the joined multiwords

multiWordsToSpans

public final Span[] multiWordsToSpans(String[] tokens)

Detects multiword expressions ignoring case.

Parameters:

tokens - the tokenized sentence

Returns:

spans of the multiword

getMaxTokenCount

public int getMaxTokenCount()

Get the key,value size of the dictionary.

Returns:

maximum token count in the dictionary