public final class WordTokenizer extends Object
Description: This class can be used like the java.util.StringTokenizer. The main difference is, that the separator tokens are Strings not characters.
Copyright: Copyright (c) 2007
| Constructor and Description |
|---|
WordTokenizer(Reader input,
String[] separatorTokens)
convenience - returnSeparators = false, caseSensitive = true
|
WordTokenizer(Reader input,
String[] separatorTokens,
boolean returnSeparators)
convenience - caseSensitive = true
|
WordTokenizer(Reader input,
String[] separatorTokens,
boolean returnSeparators,
boolean aCaseSensitive)
full constructor.
|
WordTokenizer(WordTokenizer parent,
String[] separatorTokens,
boolean returnSeparators,
boolean aCaseSensitive)
create a child!
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
addChar(int next) |
void |
continueFrom(WordTokenizer child) |
Reader |
getReader() |
boolean |
isSeparator(String token)
return true if the token is one of the receiver's separator tokens
|
protected int |
nextChar() |
String |
nextToken() |
protected int |
readNext() |
void |
setCaseSensitive(boolean aCaseSensitive) |
void |
setReturnTokens(boolean aReturnTokens) |
void |
setSeparators(String[] aSeparators) |
public WordTokenizer(Reader input, String[] separatorTokens, boolean returnSeparators, boolean aCaseSensitive)
input - - a reader that reads the string to be parsedseparatorTokens - - array of separator stringsreturnSeparators - - true when nextToken() should return separators, false otherwiseaCaseSensitive - - true when separators are caseSensitive (faster), false otherwise (slower)public WordTokenizer(WordTokenizer parent, String[] separatorTokens, boolean returnSeparators, boolean aCaseSensitive)
parent - separatorTokens - returnSeparators - aCaseSensitive - public WordTokenizer(Reader input, String[] separatorTokens, boolean returnSeparators)
input - separatorTokens - returnSeparators - public void continueFrom(WordTokenizer child)
public void setSeparators(String[] aSeparators)
public void setCaseSensitive(boolean aCaseSensitive)
public void setReturnTokens(boolean aReturnTokens)
public String nextToken() throws IOException
IOExceptionprotected int nextChar()
throws IOException
IOExceptionprotected int readNext()
throws IOException
IOExceptionpublic Reader getReader()
protected void addChar(int next)
public boolean isSeparator(String token)
token - - Not null!Copyright © 2008-2016. All Rights Reserved.