TokenType

A token representing one or more whitespace characters separating other tokens. These tokens are skipped by the normal parsing machinery, although some day we'll provide a notation within method names to capture whitespace tokens as arguments.

A token that is the entirety of an Avail method/class comment. This is text contained between slash-asterisk and asterisk-slash. Only applicable for CommentTokenDescriptor.

A single operator character, which is anything that isn't whitespace, a keyword character, or an Avail reserved character.

A literal token, detected at lexical scanning time. Only applicable for a LiteralTokenDescriptor.

A sequence of characters suitable for an Avail identifier, which roughly corresponds to characters in a Java identifier.

A special type of token that is appended to the actual tokens of the file to simplify end-of-file processing.

The associated special atom.

Answer the name of this enumeration value.

Answer an integer that identifies this enumeration value uniquely within this enumeration subclass (i.e., any enumeration class implementing this interface). These values are allocated sequentially to the enumeration values, starting at zero.