to.etc.lexer

Class ReaderTokenizerBase

java.lang.Object

to.etc.lexer.TextReaderBase

to.etc.lexer.ReaderScannerBase

to.etc.lexer.ReaderTokenizerBase

Direct Known Subclasses:

JsonReader

public class ReaderTokenizerBase
extends ReaderScannerBase

Created on Sep 9, 2004

Author:

jal

Field Summary

Fields inherited from class to.etc.lexer.ReaderScannerBase

T_BASE_LAST, T_COMMENT, T_EOF, T_IDENT, T_IPADDR, T_NUMBER, T_STRING

Constructor Summary

Constructors

Constructor and Description
ReaderTokenizerBase(Object source, Reader r)

Method Summary

Modifier and Type	Method and Description
int	getLastToken()
String	getTokenString()
boolean	isKeepQuotes()
int	nextToken()
protected int	scanString()
protected int	scanToken()
void	setKeepQuotes(boolean keepQuotes)
void	setReturnComment(boolean returnComment)
void	setReturnNewline(boolean nl)
void	setReturnWhitespace(boolean ws)
void	setScanUndottedNumbers(boolean scanUndottedNumbers)

Methods inherited from class to.etc.lexer.ReaderScannerBase

error, getSourceLocation, getTokenColumn, getTokenLine, isAllowNewlineInString, isIdChar, isIdStart, scanIdentifier, scanNumber, scanSimpleString, scanUndottedNumber, setAllowNewlineInString, skipWs, skipWsNoNL, startToken, tokenString

Methods inherited from class to.etc.lexer.TextReaderBase

accept, accept, append, append, clearCopy, copy, copy, getCopied, getCurrentColumn, getCurrentLine, getSource, LA, LA, sb

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReaderTokenizerBase

public ReaderTokenizerBase(Object source,
                           Reader r)

Method Detail

setReturnWhitespace

public void setReturnWhitespace(boolean ws)

setReturnNewline

public void setReturnNewline(boolean nl)

isKeepQuotes

public boolean isKeepQuotes()

setKeepQuotes

public void setKeepQuotes(boolean keepQuotes)

setReturnComment

public void setReturnComment(boolean returnComment)

getTokenString

public String getTokenString()

scanString

protected int scanString()
                  throws IOException,
                         SourceErrorException

Throws:

IOException

SourceErrorException

scanToken

protected int scanToken()
                 throws IOException

Throws:

IOException

getLastToken

public int getLastToken()

nextToken

public int nextToken()
              throws IOException,
                     SourceErrorException

Throws:

IOException

SourceErrorException

setScanUndottedNumbers

public void setScanUndottedNumbers(boolean scanUndottedNumbers)