to.etc.lexer

Class ReaderScannerBase

java.lang.Object

to.etc.lexer.TextReaderBase

to.etc.lexer.ReaderScannerBase

Direct Known Subclasses:

ReaderTokenizerBase, TextTokenizerBase

public class ReaderScannerBase
extends TextReaderBase

Field Summary

Fields

Modifier and Type	Field and Description
static int	T_BASE_LAST
static int	T_COMMENT
static int	T_EOF
static int	T_IDENT
static int	T_IPADDR
static int	T_NUMBER
static int	T_STRING

Constructor Summary

Constructors

Constructor and Description
ReaderScannerBase(Object source, Reader r)

Method Summary

Modifier and Type	Method and Description
RuntimeException	error(String msg)
SourceLocation	getSourceLocation()
int	getTokenColumn()
int	getTokenLine()
boolean	isAllowNewlineInString()
boolean	isIdChar(char c)
boolean	isIdStart(char c)
int	scanIdentifier()
int	scanNumber()
void	scanSimpleString(boolean keepquotes) Scans a very simple string: something starting with something, terminating with the same something and not allowing anything ugly in between.
int	scanUndottedNumber()
void	setAllowNewlineInString(boolean allowNewlineInString)
void	skipWs() Skips whitespace until current character is either EOF or non-ws.
void	skipWsNoNL() Skips whitespace until current character is either EOF or non-ws.
void	startToken() Called when a new token retrieve is started.
String	tokenString(int type)

Methods inherited from class to.etc.lexer.TextReaderBase

accept, accept, append, append, clearCopy, copy, copy, getCopied, getCurrentColumn, getCurrentLine, getSource, LA, LA, sb

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

T_EOF

public static final int T_EOF

See Also:

Constant Field Values

T_STRING

public static final int T_STRING

See Also:

Constant Field Values

T_NUMBER

public static final int T_NUMBER

See Also:

Constant Field Values

T_IPADDR

public static final int T_IPADDR

See Also:

Constant Field Values

T_IDENT

public static final int T_IDENT

See Also:

Constant Field Values

T_COMMENT

public static final int T_COMMENT

See Also:

Constant Field Values

T_BASE_LAST

public static final int T_BASE_LAST

See Also:

Constant Field Values

Constructor Detail

ReaderScannerBase

public ReaderScannerBase(Object source,
                         Reader r)

Method Detail

isAllowNewlineInString

public boolean isAllowNewlineInString()

setAllowNewlineInString

public void setAllowNewlineInString(boolean allowNewlineInString)

tokenString

public String tokenString(int type)

getTokenLine

public int getTokenLine()

getTokenColumn

public int getTokenColumn()

getSourceLocation

public SourceLocation getSourceLocation()

error

public RuntimeException error(String msg)
                       throws SourceErrorException

Throws:

SourceErrorException

skipWs

public void skipWs()
            throws IOException

Skips whitespace until current character is either EOF or non-ws.

Throws:

IOException

skipWsNoNL

public void skipWsNoNL()
                throws IOException

Skips whitespace until current character is either EOF or non-ws.

Throws:

IOException

scanSimpleString

public void scanSimpleString(boolean keepquotes)
                      throws IOException,
                             SourceErrorException

Scans a very simple string: something starting with something, terminating with the same something and not allowing anything ugly in between.

Throws:

IOException

SourceErrorException

scanUndottedNumber

public int scanUndottedNumber()
                       throws IOException

Throws:

IOException

scanNumber

public int scanNumber()
               throws IOException

Throws:

IOException

scanIdentifier

public int scanIdentifier()
                   throws IOException

Throws:

IOException

isIdStart

public boolean isIdStart(char c)

isIdChar

public boolean isIdChar(char c)

startToken

public void startToken()

Called when a new token retrieve is started. This saves the current position within the file as the start location for the token and resets the token collection buffer.