avail/avail.interpreter.execution/LexicalScanner

LexicalScanner

class LexicalScanner(val moduleNameProducer: () -> String)

A LexicalScanner tracks all visible A_Lexers while compiling a module. It maintains an AtomicReferenceArray from Latin-1 codepoints (U+0000..U+00FF) to the A_Tuple of lexers whose filters passed for that codepoint. A separate ConcurrentHashMap tracks all remaining codepoints.

There is also a special instance that is reused for scanning module headers.

Author

Mark van Gulik

Constructors

LexicalScanner

constructor(moduleNameProducer: () -> String)

Properties

allVisibleLexers

val allVisibleLexers: MutableList<A_Lexer>

The List of all lexers which are visible within the module being compiled.

frozen

@Volatile

var frozen: Boolean

When set, fail on attempts to change the lexical scanner. This is a safety measure.

moduleNameProducer

val moduleNameProducer: () -> String

A function that produces the name of the module that this scanner is operating on behalf of, or "" for the scanner used for module headers.

Functions

addLexer

@Synchronized

fun addLexer(lexer: A_Lexer)

Add an A_Lexer. Update not just the current lexing information for this loader, but also the specified atom's bundle's method and the current module.

freezeFromChanges

fun freezeFromChanges()

Ensure new A_Lexers are not added after this point. This is a safety measure.

getLexersForCodePointThen

fun getLexersForCodePointThen(lexingState: LexingState, codePoint: Int, continuation: (A_Tuple) -> Unit, onFailure: (Map<A_Lexer, Throwable>) -> Unit)

Collect the lexers that should run when we encounter a character with the given (Int) code point, then pass this tuple of lexers to the supplied Kotlin function.