| Package | Description | 
|---|---|
| org.terrier.indexing | Provides classes and interfaces related to the indexing of documents. | 
| org.terrier.indexing.tokenisation | Provides classes related to the tokenisation of documents. | 
| Class and Description | 
|---|
| Tokeniser A tokeniser class is responsible for tokenising a block of text. | 
| TokenStream Represents a stream of tokens found by a tokeniser. | 
| Class and Description | 
|---|
| Tokeniser A tokeniser class is responsible for tokenising a block of text. | 
| TokenStream Represents a stream of tokens found by a tokeniser. | 
Terrier Information Retrieval Platform4.1. Copyright © 2004-2015, University of Glasgow