eus.ixa.ixa.pipe.nerc.features

Class TokenClassFeatureGenerator

java.lang.Object

opennlp.tools.util.featuregen.FeatureGeneratorAdapter

eus.ixa.ixa.pipe.nerc.features.TokenClassFeatureGenerator

All Implemented Interfaces:

opennlp.tools.util.featuregen.AdaptiveFeatureGenerator

public class TokenClassFeatureGenerator
extends opennlp.tools.util.featuregen.FeatureGeneratorAdapter

Generates a class name for the specified token. The classes are as follows where the first matching class is used:

• lc - lowercase alphabetic
• 2d - two digits
• 4d - four digits
• an - alpha-numeric
• dd - digits and dashes
• ds - digits and slashes
• dc - digits and commas
• dp - digits and periods
• num - digits
• sc - single capital letter
• ac - all capital letters
• ic - initial capital letter
• other - other

Constructor Summary

Constructors

Constructor and Description
TokenClassFeatureGenerator()
TokenClassFeatureGenerator(boolean generateWordAndClassFeature)

Method Summary

Modifier and Type	Method and Description
void	createFeatures(List<String> features, String[] tokens, int index, String[] preds)
static String	tokenShapeFeature(String token)

Methods inherited from class opennlp.tools.util.featuregen.FeatureGeneratorAdapter

clearAdaptiveData, updateAdaptiveData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenClassFeatureGenerator

public TokenClassFeatureGenerator()

TokenClassFeatureGenerator

public TokenClassFeatureGenerator(boolean generateWordAndClassFeature)

Method Detail

createFeatures

public void createFeatures(List<String> features,
                           String[] tokens,
                           int index,
                           String[] preds)

tokenShapeFeature

public static String tokenShapeFeature(String token)