Uses of Interface
org.modeshape.common.text.TokenStream.Tokenizer

Packages that use TokenStream.Tokenizer

Package	Description
org.modeshape.common.text	A set of utilities for working with text.

Uses of TokenStream.Tokenizer in org.modeshape.common.text

Classes in org.modeshape.common.text that implement TokenStream.Tokenizer

Modifier and Type	Class and Description
static class	TokenStream.BasicTokenizer A basic TokenStream.Tokenizer implementation that ignores whitespace but includes tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.

Constructors in org.modeshape.common.text with parameters of type TokenStream.Tokenizer

Constructor and Description
TokenStream(String content, TokenStream.Tokenizer tokenizer, boolean caseSensitive)