Class TextTokenizer

    • Constructor Detail

      • TextTokenizer

        public TextTokenizer​(java.util.regex.Pattern pattern)
    • Method Detail

      • tokenize

        public abstract TokenizedString tokenize​(java.lang.String string)
      • getPattern

        public java.util.regex.Pattern getPattern()