Uses of Class
org.terrier.utility.Token
-
Packages that use Token Package Description org.terrier.utility This package includes classes that are used in various part of the Terrier Platform. -
-
Uses of Token in org.terrier.utility
Fields in org.terrier.utility declared as Token Modifier and Type Field Description Token
ParseException. currentToken
This is the last token that has been consumed successfully.Token
ClassNameParser. jj_nt
Next token.Token
Token. next
A reference to the next regular (non-special) token from the input stream.Token
Token. specialToken
This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.Token
ClassNameParser. token
Current token.Methods in org.terrier.utility that return Token Modifier and Type Method Description Token
ClassNameParser. getNextToken()
Get the next Token.Token
ClassNameParserTokenManager. getNextToken()
Get the next Token.Token
ClassNameParser. getToken(int index)
Get the specific Token.protected Token
ClassNameParserTokenManager. jjFillToken()
static Token
Token. newToken(int ofKind)
static Token
Token. newToken(int ofKind, java.lang.String image)
Returns a new Token object, by default.Constructors in org.terrier.utility with parameters of type Token Constructor Description ParseException(Token currentTokenVal, int[][] expectedTokenSequencesVal, java.lang.String[] tokenImageVal)
This constructor is used by the method "generateParseException" in the generated parser.
-