|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use Tokenizer | |
|---|---|
| org.terrier.indexing | Provides classes and interfaces related to the indexing of documents. |
| Uses of Tokenizer in org.terrier.indexing |
|---|
| Classes in org.terrier.indexing that implement Tokenizer | |
|---|---|
class |
TRECFullTokenizer
This class is the tokenizer used for indexing TREC topic files. |
class |
TRECFullUTFTokenizer
Deprecated. From 3.5, TRECFullTokenizer should be used instead, with
trec.encoding set to utf8. |
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||