Token Type
An enumeration that lists the basic kinds of tokens that can be encountered.
Author
Mark van Gulik
Entries
A special type of token that is appended to the actual tokens of the file to simplify end-of-file processing.
A literal token, detected at lexical scanning time. Only applicable for a LiteralTokenDescriptor.
A token that is the entirety of an Avail method/class comment. This is text contained between slash-asterisk and asterisk-slash. Only applicable for CommentTokenDescriptor.
A token representing one or more whitespace characters separating other tokens. These tokens are skipped by the normal parsing machinery, although some day we'll provide a notation within method names to capture whitespace tokens as arguments.
Properties
Functions
Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)
Returns an array containing the constants of this enum type, in the order they're declared.