Package com.google.refine.clustering.binning

Class NGramFingerprintKeyer

java.lang.Object

com.google.refine.clustering.binning.Keyer

com.google.refine.clustering.binning.FingerprintKeyer

com.google.refine.clustering.binning.NGramFingerprintKeyer

public class NGramFingerprintKeyer
extends FingerprintKeyer

Fingerprint keyer which generates a fingerprint from a sorted list of unique character N-grams after removing all whitespace, control characters, and punctuation. N-grams are concatenated to form a single output key.

Field Summary

Fields inherited from class com.google.refine.clustering.binning.FingerprintKeyer

DIACRITICS_AND_FRIENDS

Constructor Summary

Constructors

Constructor	Description
NGramFingerprintKeyer()

Method Summary

Modifier and Type	Method	Description
String	key(String s, Object... o)
protected TreeSet<String>	ngram_split(String s, int size)	Deprecated. 2020-10-17 by tfmorris.
protected Stream<String>	sorted_ngrams(String s, int size)	Generate a stream of sorted unique character N-grams from a string

Methods inherited from class com.google.refine.clustering.binning.FingerprintKeyer

asciify, normalize, normalize, stripDiacritics

Methods inherited from class com.google.refine.clustering.binning.Keyer

key

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

NGramFingerprintKeyer

public NGramFingerprintKeyer()

Method Details

key

public String key(String s,
 Object... o)

Overrides:

key in class FingerprintKeyer

sorted_ngrams

protected Stream<String> sorted_ngrams(String s,
 int size)

Generate a stream of sorted unique character N-grams from a string

Parameters:

s - String to generate N-grams from

size - number of characters per N-gram

Returns:

a stream of sorted unique N-gram Strings

ngram_split

@Deprecated
protected TreeSet<String> ngram_split(String s,
 int size)

Deprecated.

2020-10-17 by tfmorris. Use sorted_ngrams(String, int)