## Uses of Class
org.modeshape.common.text.TokenStream

- Packages that use TokenStream
  Package | Description
  --- | ---
  org.modeshape.common.text | A set of utilities for working with text.
  org.modeshape.jcr |
  org.modeshape.jcr.query.parse | This package defines the `QueryParser` interface, which defines a component that can parse a query represented in a specific language and produce the corresponding `abstract query model` representation.
  org.modeshape.jcr.query.xpath | The components used to parse JCR XPath queries and translate them into equivalent JCR-SQL2 queries.
  org.modeshape.sequencer.ddl | The classes that make up the DDL sequencer, which is capable of parsing the more important DDL statements from SQL-92, Oracle, Derby, and PostgreSQL, and constructing a graph structure containing a structured representation of these statements.

- - ### Uses of TokenStream in org.modeshape.common.text

    Methods in org.modeshape.common.text that return TokenStream
    Modifier and Type | Method and Description
    --- | ---
    `TokenStream` | TokenStream.`start()` Begin the token stream, including (if required) the tokenization of the input content.

  - ### Uses of TokenStream in org.modeshape.jcr

    Methods in org.modeshape.jcr with parameters of type TokenStream
    Modifier and Type | Method and Description
    --- | ---
    `protected void` | CndImporter.`parseChildNodeDefinition(TokenStream tokens, JcrNodeTypeTemplate nodeType)` Parse a node type's child node definition from the next tokens on the stream.
    `protected void` | CndImporter.`parseDefaultType(TokenStream tokens, org.modeshape.jcr.JcrNodeDefinitionTemplate childDefn)` Parse the child node definition's default type, if they appear next on the token stream.
    `protected void` | CndImporter.`parseDefaultValues(TokenStream tokens, org.modeshape.jcr.JcrPropertyDefinitionTemplate propDefn)` Parse the property definition's default value, if they appear next on the token stream.
    `protected Name` | CndImporter.`parseName(TokenStream tokens)` Parse the name that is expected to be next on the token stream.
    `protected List<Name>` | CndImporter.`parseNameList(TokenStream tokens)` Parse a list of names, separated by commas.
    `protected void` | CndImporter.`parseNamespaceMapping(TokenStream tokens)` Parse the namespace mapping statement that is next on the token stream.
    `protected void` | CndImporter.`parseNodeAttributes(TokenStream tokens, org.modeshape.jcr.JcrNodeDefinitionTemplate childDefn, JcrNodeTypeTemplate nodeType)` Parse the child node definition's attributes, if they appear next on the token stream.
    `protected void` | CndImporter.`parseNodeTypeDefinition(TokenStream tokens)` Parse the node type definition that is next on the token stream.
    `protected Name` | CndImporter.`parseNodeTypeName(TokenStream tokens)` Parse a node type name that appears next on the token stream.
    `protected void` | CndImporter.`parseNodeTypeOptions(TokenStream tokens, JcrNodeTypeTemplate nodeType)` Parse the options for the node types, including whether the node type is orderable, a mixin, abstract, whether it supports querying, and which property/child node (if any) is the primary item for the node type.
    `protected void` | CndImporter.`parsePropertyAttributes(TokenStream tokens, org.modeshape.jcr.JcrPropertyDefinitionTemplate propDefn, JcrNodeTypeTemplate nodeType)` Parse the property definition's attributes, if they appear next on the token stream.
    `protected void` | CndImporter.`parsePropertyDefinition(TokenStream tokens, JcrNodeTypeTemplate nodeType)` Parse a node type's property definition from the next tokens on the stream.
    `protected void` | CndImporter.`parsePropertyOrChildNodeDefinitions(TokenStream tokens, JcrNodeTypeTemplate nodeType)` Parse a node type's property or child node definitions that appear next on the token stream.
    `protected void` | CndImporter.`parsePropertyType(TokenStream tokens, org.modeshape.jcr.JcrPropertyDefinitionTemplate propDefn, String defaultPropertyType)` Parse the property type, if a valid one appears next on the token stream.
    `protected void` | CndImporter.`parseQueryOperators(TokenStream tokens, org.modeshape.jcr.JcrPropertyDefinitionTemplate propDefn)` Parse the property definition's query operators, if they appear next on the token stream.
    `protected void` | CndImporter.`parseRequiredPrimaryTypes(TokenStream tokens, org.modeshape.jcr.JcrNodeDefinitionTemplate childDefn)` Parse the child node definition's list of required primary types, if they appear next on the token stream.
    `protected List<String>` | CndImporter.`parseStringList(TokenStream tokens)` Parse a list of strings, separated by commas.
    `protected List<Name>` | CndImporter.`parseSupertypes(TokenStream tokens)` Parse an optional list of supertypes if they appear next on the token stream.
    `protected void` | CndImporter.`parseValueConstraints(TokenStream tokens, org.modeshape.jcr.JcrPropertyDefinitionTemplate propDefn)` Parse the property definition's value constraints, if they appear next on the token stream.
    `protected void` | CndImporter.`parseVendorExtensions(TokenStream tokens, List<Property> properties)` Parse the vendor extensions that may appear next on the tokenzied stream.

  - ### Uses of TokenStream in org.modeshape.jcr.query.parse

    Methods in org.modeshape.jcr.query.parse with parameters of type TokenStream
    Modifier and Type | Method and Description
    --- | ---
    `FullTextSearch.Term` | FullTextSearchParser.`parse(TokenStream tokens)` Parse the full-text search criteria from the supplied token stream.
    `protected BindVariableName` | BasicSqlQueryParser.`parseBindVariableName(TokenStream tokens, TypeSystem typeSystem)`
    `protected Operator` | BasicSqlQueryParser.`parseComparisonOperator(TokenStream tokens)`
    `protected Constraint` | JcrSqlQueryParser.`parseConstraint(TokenStream tokens, TypeSystem typeSystem, Source source)` Parse a constraint clause.
    `protected Constraint` | BasicSqlQueryParser.`parseConstraint(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected FullTextSearch.Term` | FullTextSearchParser.`parseDisjunctedTerms(TokenStream tokens)`
    `protected DynamicOperand` | BasicSqlQueryParser.`parseDynamicOperand(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected Source` | JcrSqlQueryParser.`parseFrom(TokenStream tokens, TypeSystem typeSystem)`
    `protected Source` | BasicSqlQueryParser.`parseFrom(TokenStream tokens, TypeSystem typeSystem)`
    `protected List<StaticOperand>` | BasicSqlQueryParser.`parseInClause(TokenStream tokens, TypeSystem typeSystem)`
    `protected JoinCondition` | BasicSqlQueryParser.`parseJoinCondition(TokenStream tokens, TypeSystem typeSystem)`
    `protected Limit` | BasicSqlQueryParser.`parseLimit(TokenStream tokens)`
    `protected Literal` | BasicSqlQueryParser.`parseLiteral(TokenStream tokens, TypeSystem typeSystem)`
    `protected Object` | JcrSqlQueryParser.`parseLiteralValue(TokenStream tokens, TypeSystem typeSystem)`
    `protected Object` | BasicSqlQueryParser.`parseLiteralValue(TokenStream tokens, TypeSystem typeSystem)`
    `protected String` | JcrSqlQueryParser.`parseName(TokenStream tokens, TypeSystem typeSystem)` Parsing behavior is overridden to that JCR-SQL style (unquoted prefixed) names are allowed.
    `protected String` | BasicSqlQueryParser.`parseName(TokenStream tokens, TypeSystem typeSystem)`
    `protected NamedSelector` | BasicSqlQueryParser.`parseNamedSelector(TokenStream tokens, TypeSystem typeSystem)`
    `protected List<Ordering>` | BasicSqlQueryParser.`parseOrderBy(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected Ordering` | BasicSqlQueryParser.`parseOrdering(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected String` | BasicSqlQueryParser.`parsePath(TokenStream tokens, TypeSystem typeSystem)`
    `protected Constraint` | JcrSqlQueryParser.`parsePropertyExistance(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected Constraint` | BasicSqlQueryParser.`parsePropertyExistance(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected PropertyValue` | BasicSqlQueryParser.`parsePropertyValue(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected Query` | JcrSqlQueryParser.`parseQuery(TokenStream tokens, TypeSystem typeSystem)`
    `protected Query` | BasicSqlQueryParser.`parseQuery(TokenStream tokens, TypeSystem typeSystem)`
    `protected QueryCommand` | BasicSqlQueryParser.`parseQueryCommand(TokenStream tokens, TypeSystem typeSystem)`
    `protected ReferenceValue` | BasicSqlQueryParser.`parseReferenceValue(TokenStream tokens, TypeSystem typeSystem, Source source)`
    `protected List<org.modeshape.jcr.query.parse.ColumnExpression>` | BasicSqlQueryParser.`parseSelect(TokenStream tokens, AtomicBoolean isDistinct, TypeSystem typeSystem)`
    `protected SelectorName` | BasicSqlQueryParser.`parseSelectorName(TokenStream tokens, TypeSystem typeSystem)`
    `protected SetQuery` | BasicSqlQueryParser.`parseSetQuery(TokenStream tokens, QueryCommand leftHandSide, TypeSystem typeSystem)`
    `protected StaticOperand` | BasicSqlQueryParser.`parseStaticOperand(TokenStream tokens, TypeSystem typeSystem)`
    `protected FullTextSearch.Term` | FullTextSearchParser.`parseTerm(TokenStream tokens)`
    `protected Constraint` | BasicSqlQueryParser.`parseWhere(TokenStream tokens, TypeSystem typeSystem, Source source)`

  - ### Uses of TokenStream in org.modeshape.jcr.query.xpath

    Methods in org.modeshape.jcr.query.xpath with parameters of type TokenStream
    Modifier and Type | Method and Description
    --- | ---
    `protected XPath.Component` | XPathParser.`parseAdditiveExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseAndExpr(TokenStream tokens)`
    `protected XPath.AnyKindTest` | XPathParser.`parseAnyKindTest(TokenStream tokens)`
    `protected XPath.NameTest` | XPathParser.`parseAtomicType(TokenStream tokens)`
    `protected XPath.AttributeTest` | XPathParser.`parseAttributeTest(TokenStream tokens)`
    `protected XPath.AxisStep` | XPathParser.`parseAxisStep(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseCastableExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseCastExpr(TokenStream tokens)`
    `protected XPath.CommentTest` | XPathParser.`parseCommentTest(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseComparisonExpr(TokenStream tokens)`
    `protected XPath.ContextItem` | XPathParser.`parseContextItemExpr(TokenStream tokens)`
    `protected XPath.DocumentTest` | XPathParser.`parseDocumentTest(TokenStream tokens)`
    `protected XPath.ElementTest` | XPathParser.`parseElementTest(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseExprSingle(TokenStream tokens)`
    `protected XPath.FilterStep` | XPathParser.`parseFilterExpr(TokenStream tokens)`
    `protected XPath.FunctionCall` | XPathParser.`parseFunctionCall(TokenStream tokens)`
    `protected Operator` | XPathParser.`parseGeneralComp(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseInstanceofExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseIntersectExceptExpr(TokenStream tokens)`
    `protected XPath.NameTest` | XPathParser.`parseItemType(TokenStream tokens)`
    `protected XPath.KindTest` | XPathParser.`parseKindTest(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseMultiplicativeExpr(TokenStream tokens)`
    `protected XPath.NameTest` | XPathParser.`parseNameTest(TokenStream tokens)`
    `protected String` | XPathParser.`parseNCName(TokenStream tokens)`
    `protected XPath.NodeComparisonOperator` | XPathParser.`parseNodeComp(TokenStream tokens)`
    `protected XPath.NodeTest` | XPathParser.`parseNodeTest(TokenStream tokens)`
    `protected XPath.Literal` | XPathParser.`parseNumericLiteral(TokenStream tokens)`
    `protected XPath.OrderBy` | XPathParser.`parseOrderBy(TokenStream tokens)`
    `protected XPath.OrderBySpec` | XPathParser.`parseOrderBySpec(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseOrExpr(TokenStream tokens)`
    `protected XPath.ParenthesizedExpression` | XPathParser.`parseParenthesizedExpr(TokenStream tokens)`
    `protected XPath.PathExpression` | XPathParser.`parsePathExpr(TokenStream tokens)`
    `protected XPath.ProcessingInstructionTest` | XPathParser.`parsePITest(TokenStream tokens)`
    `protected List<XPath.Component>` | XPathParser.`parsePredicates(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parsePrimaryExpr(TokenStream tokens)`
    `protected XPath.NameTest` | XPathParser.`parseQName(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseRangeExpr(TokenStream tokens)`
    `protected XPath.PathExpression` | XPathParser.`parseRelativePathExpr(TokenStream tokens)`
    `protected XPath.SchemaAttributeTest` | XPathParser.`parseSchemaAttributeTest(TokenStream tokens)`
    `protected XPath.SchemaElementTest` | XPathParser.`parseSchemaElementTest(TokenStream tokens)`
    `protected void` | XPathParser.`parseSequenceType(TokenStream tokens)`
    `protected void` | XPathParser.`parseSingleType(TokenStream tokens)`
    `protected XPath.StepExpression` | XPathParser.`parseStepExpr(TokenStream tokens)`
    `protected XPath.Literal` | XPathParser.`parseStringLiteral(TokenStream tokens)`
    `protected XPath.TextTest` | XPathParser.`parseTextTest(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseTreatExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseUnaryExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseUnionExpr(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseValueComp(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseValueExpr(TokenStream tokens)`
    `protected XPath.NameTest` | XPathParser.`parseWildcard(TokenStream tokens)`
    `protected XPath.Component` | XPathParser.`parseXPath(TokenStream tokens)`

  - ### Uses of TokenStream in org.modeshape.sequencer.ddl

    Subclasses of TokenStream in org.modeshape.sequencer.ddl
    Modifier and Type | Class and Description
    --- | ---
    `class` | `DdlTokenStream` A TokenStream implementation designed around requirements for tokenizing and parsing DDL statements.

Copyright © 2008-2014 JBoss, a division of Red Hat. All Rights Reserved.