org.maochen.nlp.ml.classifier.maxent

Class OnePassRealValueDataIndexer

java.lang.Object

org.maochen.nlp.ml.classifier.maxent.OnePassRealValueDataIndexer

All Implemented Interfaces:

opennlp.model.DataIndexer

public class OnePassRealValueDataIndexer
extends Object
implements opennlp.model.DataIndexer

An indexer for maxent model data which handles cutoffs for uncommon contextual predicates and provides a unique integer index for each of the predicates and maintains event values.

Field Summary

Fields

Modifier and Type	Field and Description
protected int[][]	contexts The integer contexts associated with each unique event.
protected int[]	numTimesEventsSeen The number of times an event occured in the training data.
protected String[]	outcomeLabels The names of the outcomes.
protected int[]	outcomeList The integer outcome associated with each unique event.
protected int[]	predCounts The number of times each predicate occured.
protected String[]	predLabels The predicate/context names.

Constructor Summary

Constructors

Constructor and Description
OnePassRealValueDataIndexer(EventStream eventStream, int cutoff, boolean sort)

Method Summary

Modifier and Type	Method and Description
int[][]	getContexts()
int	getNumEvents()
int[]	getNumTimesEventsSeen()
String[]	getOutcomeLabels()
int[]	getOutcomeList()
int[]	getPredCounts()
String[]	getPredLabels()
float[][]	getValues()
protected List<opennlp.model.ComparableEvent>	index(LinkedList<opennlp.model.Event> events, Map<String,Integer> predicateIndex)
protected int	sortAndMerge(List<opennlp.model.ComparableEvent> eventsToCompare, boolean sort)
protected static String[]	toIndexedStringArray(Map<String,Integer> labelToIndexMap) Utility method for creating a String[] array from a map whose keys are labels (Strings) to be stored in the array and whose values are the indices (Integers) at which the corresponding labels should be inserted.
protected static void	update(String[] ec, Set<String> predicateSet, Map<String,Integer> counter, int cutoff) Updates the set of predicated and counter with the specified event contexts and cutoff.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

contexts

protected int[][] contexts

The integer contexts associated with each unique event.

outcomeList

protected int[] outcomeList

The integer outcome associated with each unique event.

outcomeLabels

protected String[] outcomeLabels

The names of the outcomes.

numTimesEventsSeen

protected int[] numTimesEventsSeen

The number of times an event occured in the training data.

predLabels

protected String[] predLabels

The predicate/context names.

predCounts

protected int[] predCounts

The number of times each predicate occured.

Constructor Detail

OnePassRealValueDataIndexer

public OnePassRealValueDataIndexer(EventStream eventStream,
                                   int cutoff,
                                   boolean sort)

Method Detail

update

protected static void update(String[] ec,
                             Set<String> predicateSet,
                             Map<String,Integer> counter,
                             int cutoff)

Updates the set of predicated and counter with the specified event contexts and cutoff.

Parameters:

ec - The contexts/features which occur in a event.

predicateSet - The set of predicates which will be used for model building.

counter - The predicate counters.

cutoff - The cutoff which determines whether a predicate is included.

sortAndMerge

protected int sortAndMerge(List<opennlp.model.ComparableEvent> eventsToCompare,
                           boolean sort)

toIndexedStringArray

protected static String[] toIndexedStringArray(Map<String,Integer> labelToIndexMap)

Utility method for creating a String[] array from a map whose keys are labels (Strings) to be stored in the array and whose values are the indices (Integers) at which the corresponding labels should be inserted.

Parameters:

labelToIndexMap - a TObjectIntHashMap value

Returns:

a String[] value

Since:

maxent 1.2.6

index

protected List<opennlp.model.ComparableEvent> index(LinkedList<opennlp.model.Event> events,
                                                    Map<String,Integer> predicateIndex)

getNumEvents

public int getNumEvents()

Specified by:

getNumEvents in interface opennlp.model.DataIndexer

getContexts

public int[][] getContexts()

Specified by:

getContexts in interface opennlp.model.DataIndexer

getNumTimesEventsSeen

public int[] getNumTimesEventsSeen()

Specified by:

getNumTimesEventsSeen in interface opennlp.model.DataIndexer

getOutcomeList

public int[] getOutcomeList()

Specified by:

getOutcomeList in interface opennlp.model.DataIndexer

getPredLabels

public String[] getPredLabels()

Specified by:

getPredLabels in interface opennlp.model.DataIndexer

getPredCounts

public int[] getPredCounts()

Specified by:

getPredCounts in interface opennlp.model.DataIndexer

getOutcomeLabels

public String[] getOutcomeLabels()

Specified by:

getOutcomeLabels in interface opennlp.model.DataIndexer

getValues

public float[][] getValues()

Specified by:

getValues in interface opennlp.model.DataIndexer