Module org.praxislive.core

Package org.praxislive.core.syntax

Class Tokenizer

java.lang.Object

org.praxislive.core.syntax.Tokenizer

All Implemented Interfaces:

Iterable<Token>

public class Tokenizer
extends Object
implements Iterable<Token>

Class to split a CharSequence into Tokens.

Constructor Summary

Constructors

Constructor	Description
Tokenizer(CharSequence text)	Create a Tokenizer for the specified text.

Method Summary

Modifier and Type	Method	Description
Iterator<Token>	iterator()
static List<Token>	parse(CharSequence text)	Convenience method to parse text into tokens.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Details

Tokenizer

public Tokenizer(CharSequence text)

Create a Tokenizer for the specified text.

Parameters:

text -

Method Details

iterator

public Iterator<Token> iterator()

Specified by:

iterator in interface Iterable<Token>

parse

public static List<Token> parse(CharSequence text)

Convenience method to parse text into tokens. This method will throw an exception if the text is invalid. If you need a partial token sequence, use the iterator directly.

Parameters:

text - text to parse

Returns:

list of tokens

Throws:

InvalidSyntaxException - if the text is invalid