MessageSplitterTokenizer

class MessageSplitterTokenizer constructor(messageName: A_String)

MessageSplitterTokenizer breaks a message name into a sequence of token strings.

Mark van Gulik

Todd L Smith

messageName

An Avail string specifying the keywords and arguments of some message being defined.

If the message name is malformed.

Constructors

constructor(messageName: A_String)

Construct a new MessageSplitter, parsing the provided message into token strings and generating parsing for parsing occurrences of this message.

The A_String to be parsed into message token strings.

Answer the message parts that this tokenizer has produced, but mapped to canonical values to minimize the cost of storage and indirections.

Access the (read-only) array of one-based positions of tokens in the original string.