Terrier IR Platform

Uses of Interface

Packages that use Tokenizer
uk.ac.gla.terrier.indexing Provides classes and interfaces related to the indexing of documents. 

Uses of Tokenizer in uk.ac.gla.terrier.indexing

Classes in uk.ac.gla.terrier.indexing that implement Tokenizer
 class TRECFullTokenizer
          This class is the tokenizer used for indexing TREC topic files.
 class TRECFullUTFTokenizer
          This is a subclass of TRECFullTokenizer, which is less restrictive than it's parent.

Terrier IR Platform

Terrier Information Retrieval Platform 2.2.1. Copyright 2004-2008 University of Glasgow