lexer
Answer the function to run (as the base call of a fiber) to generate some tokens from the source string and position. The function should produce a tuple of potential next tokens, which may or may not have additional tokens explicitly chained onto them via A_Token.setNextLexingStateFromPrior.
Return
The lexer's body function.