Uses of Class
org.terrier.utility.Token
-
Packages that use Token Package Description org.terrier.utility This package includes classes that are used in various part of the Terrier Platform. -
-
Uses of Token in org.terrier.utility
Fields in org.terrier.utility declared as Token Modifier and Type Field Description TokenParseException. currentTokenThis is the last token that has been consumed successfully.TokenClassNameParser. jj_ntNext token.TokenToken. nextA reference to the next regular (non-special) token from the input stream.TokenToken. specialTokenThis field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.TokenClassNameParser. tokenCurrent token.Methods in org.terrier.utility that return Token Modifier and Type Method Description TokenClassNameParser. getNextToken()Get the next Token.TokenClassNameParserTokenManager. getNextToken()Get the next Token.TokenClassNameParser. getToken(int index)Get the specific Token.protected TokenClassNameParserTokenManager. jjFillToken()static TokenToken. newToken(int ofKind)static TokenToken. newToken(int ofKind, java.lang.String image)Returns a new Token object, by default.Constructors in org.terrier.utility with parameters of type Token Constructor Description ParseException(Token currentTokenVal, int[][] expectedTokenSequencesVal, java.lang.String[] tokenImageVal)This constructor is used by the method "generateParseException" in the generated parser.
-