ATESyntaxLexer (ANTLRWorks 1.5.2 API)

java.lang.Object
- org.antlr.works.ate.syntax.generic.ATESyntaxLexer

Direct Known Subclasses:

ATEJavaSyntaxLexer, ATEStringTemplateSyntaxLexer, GrammarSyntaxLexer
```
public class ATESyntaxLexer
extends Object
```

Field Summary

Fields
Modifier and Type	Field and Description
`protected char`	`c0` c0 and c1 are character cache for quick access to the current character (c0) and the next character (c1)
`protected char`	`c1`
`protected boolean`	`controlCharacter` True if the current character is a control character (that is preceeded by a \)
`protected int`	`lineIndex`
`protected int`	`lineNumber`
`protected List<ATELine>`	`lines`
`protected int`	`position`
`protected String`	`text`
`static int`	`TOKEN_CHAR`
`static int`	`TOKEN_COLON`
`static int`	`TOKEN_COMPLEX_COMMENT`
`static int`	`TOKEN_DOUBLE_QUOTE_STRING`
`static int`	`TOKEN_ID`
`static int`	`TOKEN_LBRACK`
`static int`	`TOKEN_LCURLY`
`static int`	`TOKEN_LPAREN`
`static int`	`TOKEN_OTHER`
`static int`	`TOKEN_RBRACK`
`static int`	`TOKEN_RCURLY`
`static int`	`TOKEN_RPAREN`
`static int`	`TOKEN_SEMI`
`static int`	`TOKEN_SINGLE_COMMENT`
`static int`	`TOKEN_SINGLE_QUOTE_STRING`
`protected List<ATEToken>`	`tokens`

Constructor Summary

Constructors
Constructor and Description

ATESyntaxLexer()

Constructors
Constructor and Description
`ATESyntaxLexer()`

Method Summary

Methods
Modifier and Type	Method and Description
`void`	`addToken(ATEToken token)`
`void`	`close()`
`ATEToken`	`createNewToken(int type)`
`ATEToken`	`createNewToken(int type, int start)`
`ATEToken`	`createNewToken(int type, int start, int end)`
`ATEToken`	`createNewToken(int type, int start, int end, int startLineNumber, int endLineNumber, int startLineIndex, int endLineIndex)`
`protected ATEToken`	`customMatch()`
`int`	`getLineNumber()`
`List<ATELine>`	`getLines()`
`List<ATEToken>`	`getTokens()`
`boolean`	`isID(char c)`
`boolean`	`isLetter()`
`boolean`	`isLetterOrDigit()`
`boolean`	`isLetterOrDigit(char c)`
`boolean`	`isWhitespace()`
`ATEToken`	`matchComplexComment()`
`ATEToken`	`matchDoubleQuoteString()`
`protected ATEToken`	`matchID()`
`boolean`	`matchNewLine()`
`ATEToken`	`matchSingleComment()`
`ATEToken`	`matchSingleQuoteString()`
`boolean`	`nextCharacter()`
`protected void`	`tokenize()`
`void`	`tokenize(String text)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail
- TOKEN_SINGLE_QUOTE_STRING
```
public static final int TOKEN_SINGLE_QUOTE_STRING
```
  See Also:
  Constant Field Values
- TOKEN_DOUBLE_QUOTE_STRING
```
public static final int TOKEN_DOUBLE_QUOTE_STRING
```
  See Also:
  Constant Field Values
- TOKEN_SINGLE_COMMENT
```
public static final int TOKEN_SINGLE_COMMENT
```
  See Also:
  Constant Field Values
- TOKEN_COMPLEX_COMMENT
```
public static final int TOKEN_COMPLEX_COMMENT
```
  See Also:
  Constant Field Values
- TOKEN_ID
```
public static final int TOKEN_ID
```
  See Also:
  Constant Field Values
- TOKEN_CHAR
```
public static final int TOKEN_CHAR
```
  See Also:
  Constant Field Values
- TOKEN_LPAREN
```
public static final int TOKEN_LPAREN
```
  See Also:
  Constant Field Values
- TOKEN_RPAREN
```
public static final int TOKEN_RPAREN
```
  See Also:
  Constant Field Values
- TOKEN_LCURLY
```
public static final int TOKEN_LCURLY
```
  See Also:
  Constant Field Values
- TOKEN_RCURLY
```
public static final int TOKEN_RCURLY
```
  See Also:
  Constant Field Values
- TOKEN_LBRACK
```
public static final int TOKEN_LBRACK
```
  See Also:
  Constant Field Values
- TOKEN_RBRACK
```
public static final int TOKEN_RBRACK
```
  See Also:
  Constant Field Values
- TOKEN_COLON
```
public static final int TOKEN_COLON
```
  See Also:
  Constant Field Values
- TOKEN_SEMI
```
public static final int TOKEN_SEMI
```
  See Also:
  Constant Field Values
- TOKEN_OTHER
```
public static final int TOKEN_OTHER
```
  See Also:
  Constant Field Values
- tokens
```
protected List<ATEToken> tokens
```
- text
```
protected String text
```
- position
```
protected int position
```
- lineNumber
```
protected int lineNumber
```
- lineIndex
```
protected int lineIndex
```
- lines
```
protected List<ATELine> lines
```
- controlCharacter
```
protected boolean controlCharacter
```
  True if the current character is a control character (that is preceeded by a \)
- c0
```
protected char c0
```
  c0 and c1 are character cache for quick access to the current character (c0) and the next character (c1)
- c1
```
protected char c1
```

Constructor Detail
- ATESyntaxLexer
```
public ATESyntaxLexer()
```

Method Detail

close
```
public void close()
```

getTokens
```
public List<ATEToken> getTokens()
```

getLines
```
public List<ATELine> getLines()
```

getLineNumber
```
public int getLineNumber()
```

tokenize
```
public void tokenize(String text)
```

tokenize
```
protected void tokenize()
```

customMatch
```
protected ATEToken customMatch()
```

addToken
```
public void addToken(ATEToken token)
```

matchID
```
protected ATEToken matchID()
```

matchSingleQuoteString

public ATEToken matchSingleQuoteString()

matchDoubleQuoteString

public ATEToken matchDoubleQuoteString()

matchSingleComment
```
public ATEToken matchSingleComment()
```

matchComplexComment
```
public ATEToken matchComplexComment()
```

nextCharacter
```
public boolean nextCharacter()
```

matchNewLine
```
public boolean matchNewLine()
```

isWhitespace
```
public boolean isWhitespace()
```

isLetter
```
public boolean isLetter()
```

isLetterOrDigit
```
public boolean isLetterOrDigit()
```

isLetterOrDigit

public boolean isLetterOrDigit(char c)

isID
```
public boolean isID(char c)
```

createNewToken

public ATEToken createNewToken(int type)

createNewToken

public ATEToken createNewToken(int type,
                      int start)

createNewToken

public ATEToken createNewToken(int type,
                      int start,
                      int end)

createNewToken

public ATEToken createNewToken(int type,
                      int start,
                      int end,
                      int startLineNumber,
                      int endLineNumber,
                      int startLineIndex,
                      int endLineIndex)

Class ATESyntaxLexer

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

TOKEN_SINGLE_QUOTE_STRING

TOKEN_DOUBLE_QUOTE_STRING

TOKEN_SINGLE_COMMENT

TOKEN_COMPLEX_COMMENT

TOKEN_ID

TOKEN_CHAR

TOKEN_LPAREN

TOKEN_RPAREN

TOKEN_LCURLY

TOKEN_RCURLY

TOKEN_LBRACK

TOKEN_RBRACK

TOKEN_COLON

TOKEN_SEMI

TOKEN_OTHER

tokens

text

position

lineNumber

lineIndex

lines

controlCharacter

c0

c1

Constructor Detail

ATESyntaxLexer

Method Detail

close

getTokens

getLines

getLineNumber

tokenize

tokenize

customMatch

addToken

matchID

matchSingleQuoteString

matchDoubleQuoteString

matchSingleComment

matchComplexComment

nextCharacter

matchNewLine

isWhitespace

isLetter

isLetterOrDigit

isLetterOrDigit

isID

createNewToken

createNewToken

createNewToken

createNewToken