Eventually invoke the given function with the list of tokens at this position. If necessary, launch fibers to run lexers, invoking the continuation only when all possible next tokens have been computed.
What to do with the list of tokens.