## Uses of Interface
org.modeshape.common.text.TokenStream.Tokens

- Packages that use TokenStream.Tokens
  Package | Description
  --- | ---
  org.modeshape.common.text | A set of utilities for working with text.
  org.modeshape.jcr |
  org.modeshape.jcr.query.parse | This package defines the `QueryParser` interface, which defines a component that can parse a query represented in a specific language and produce the corresponding `abstract query model` representation.
  org.modeshape.jcr.query.xpath | The components used to parse JCR XPath queries and translate them into equivalent JCR-SQL2 queries.
  org.modeshape.sequencer.ddl | The classes that make up the DDL sequencer, which is capable of parsing the more important DDL statements from SQL-92, Oracle, Derby, and PostgreSQL, and constructing a graph structure containing a structured representation of these statements.

- - ### Uses of TokenStream.Tokens in org.modeshape.common.text

    Classes in org.modeshape.common.text that implement TokenStream.Tokens
    Modifier and Type | Class and Description
    --- | ---
    `class` | `TokenStream.CaseInsensitiveTokenFactory`
    `class` | `TokenStream.CaseSensitiveTokenFactory`
    `protected class` | `TokenStream.TokenFactory`

    Methods in org.modeshape.common.text with parameters of type TokenStream.Tokens
    Modifier and Type | Method and Description
    --- | ---
    `void` | TokenStream.Tokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)` Process the supplied characters and construct the appropriate `TokenStream.Token` objects.
    `void` | TokenStream.BasicTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)`

  - ### Uses of TokenStream.Tokens in org.modeshape.jcr

    Methods in org.modeshape.jcr with parameters of type TokenStream.Tokens
    Modifier and Type | Method and Description
    --- | ---
    `void` | CndTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)` Process the supplied characters and construct the appropriate `TokenStream.Token` objects.

  - ### Uses of TokenStream.Tokens in org.modeshape.jcr.query.parse

    Methods in org.modeshape.jcr.query.parse with parameters of type TokenStream.Tokens
    Modifier and Type | Method and Description
    --- | ---
    `void` | FullTextSearchParser.TermTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)`
    `void` | BasicSqlQueryParser.SqlTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)`

  - ### Uses of TokenStream.Tokens in org.modeshape.jcr.query.xpath

    Methods in org.modeshape.jcr.query.xpath with parameters of type TokenStream.Tokens
    Modifier and Type | Method and Description
    --- | ---
    `void` | XPathParser.XPathTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)`

  - ### Uses of TokenStream.Tokens in org.modeshape.sequencer.ddl

    Methods in org.modeshape.sequencer.ddl with parameters of type TokenStream.Tokens
    Modifier and Type | Method and Description
    --- | ---
    `void` | DdlTokenStream.DdlTokenizer.`tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens)` Process the supplied characters and construct the appropriate `TokenStream.Token` objects.

Copyright © 2008-2014 JBoss, a division of Red Hat. All Rights Reserved.