eus.ixa.ixa.pipe.tok

Class StringUtils

java.lang.Object

eus.ixa.ixa.pipe.tok.StringUtils

public class StringUtils
extends Object

Several string utils. The functions of this class are to be used statically.

Version:

2015-04-14

Author:

ragerri

Field Summary

Fields

Modifier and Type	Field and Description
static Pattern	doubleBar Pattern to remove double bars from disjunct regex.

Method Summary

Methods

Modifier and Type	Method and Description
static String	createDisjunctRegexFromList(List<String> words)
static String	getStringFromTokens(List<Token> tokens) Get a List of Strings and convert it into a string separated by spaces.
static String	getStringFromTokens(String[] tokens) Get an array of Strings and convert it into a string separated by spaces.
static String	readText(BufferedReader breader) Reads standard input text from the BufferedReader and adds a line break mark for every line.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

doubleBar

public static Pattern doubleBar

Pattern to remove double bars from disjunct regex.

Method Detail

getStringFromTokens

public static String getStringFromTokens(String[] tokens)

Get an array of Strings and convert it into a string separated by spaces.

Parameters:

tokens - the array

Returns:

the string

getStringFromTokens

public static String getStringFromTokens(List<Token> tokens)

Get a List of Strings and convert it into a string separated by spaces.

Parameters:

tokens - the list of tokens

Returns:

the string

createDisjunctRegexFromList

public static String createDisjunctRegexFromList(List<String> words)

readText

public static String readText(BufferedReader breader)

Reads standard input text from the BufferedReader and adds a line break mark for every line. The output of this functions is then further processed by methods called in the constructors of the SentenceSegmenter and Tokenizer.

Parameters:

breader - the buffered reader

Returns:

the input text in a string object