get
fun getLexersForCodePointThen( lexingState: LexingState, codePoint: Int, continuation: (A_Tuple) -> Unit, onFailure: (Map<A_Lexer, Throwable>) -> Unit)
Content copied to clipboard
Collect the lexers that should run when we encounter a character with the given (Int) code point, then pass this tuple of lexers to the supplied Kotlin function.
We pass it forward rather than return it, since sometimes this requires lexer filter functions to run, which we must not do synchronously. However, if the lexer filters have already run for this code point, we may invoke the continuation synchronously for performance.
Parameters
lexing
The LexingState at which the lexical scanning is happening.
code
The full Unicode code point in the range 0..1,114,111.
continuation
What to invoke with the tuple of tokens at this position.
on
What to do if lexical scanning fails.