MessageSplitterTokenizer

class MessageSplitterTokenizer constructor(messageName: A_String)

MessageSplitterTokenizer breaks a message name into a sequence of token strings.

Mark van Gulik

Todd L Smith

Parameters

messageName

An Avail string specifying the keywords and arguments of some message being defined.

    If the message name is malformed.

Construct a new MessageSplitter, parsing the provided message into token strings and generating parsing for parsing occurrences of this message.

Answer the message parts that this tokenizer has produced, but mapped to canonical values to minimize the cost of storage and indirections.

Access the (read-only) array of one-based positions of tokens in the original string.

The A_String to be parsed into message token strings.