public class IdentityTokeniser extends Tokeniser
EMPTY_STREAM
Constructor and Description |
---|
IdentityTokeniser() |
Modifier and Type | Method and Description |
---|---|
TokenStream |
tokenise(Reader reader)
Tokenises the text obtained from the specified reader.
|
getTokeniser, getTokens
public TokenStream tokenise(Reader reader)
Tokeniser
Terrier 4.0. Copyright © 2004-2014 University of Glasgow