org.terrier.structures.indexing.singlepass.hadoop

Class Hadoop_BlockSinglePassIndexer.DelimTermProcessor

java.lang.Object

org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BlockSinglePassIndexer.DelimTermProcessor

All Implemented Interfaces:

TermPipeline

Enclosing class:

Hadoop_BlockSinglePassIndexer

protected class Hadoop_BlockSinglePassIndexer.DelimTermProcessor
extends Object
implements TermPipeline

This class behaves in a similar fashion to BasicTermProcessor except that this one treats blocks bounded by delimiters instead of fixed-sized blocks.

Since:

2.2

Author:

Rodrygo Santos

Field Summary

Fields

Modifier and Type	Field and Description
protected gnu.trove.THashSet<String>	blockDelimiterTerms
protected boolean	countDelimiters
protected boolean	indexDelimiters

Constructor Summary

Constructors

Constructor and Description
Hadoop_BlockSinglePassIndexer.DelimTermProcessor(String[] _delims, boolean _indexDelimiters, boolean _countDelimiters)

Method Summary

Methods

Modifier and Type	Method and Description
void	processTerm(String t) Processes a term using the current term pipeline component and passes the output to the next pipeline component, if the term has not been discarded.
boolean	reset() This method implements the specific rest option needed to implements query or doc oriented policy.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

blockDelimiterTerms

protected gnu.trove.THashSet<String> blockDelimiterTerms

indexDelimiters

protected final boolean indexDelimiters

countDelimiters

protected final boolean countDelimiters

Constructor Detail

Hadoop_BlockSinglePassIndexer.DelimTermProcessor

public Hadoop_BlockSinglePassIndexer.DelimTermProcessor(String[] _delims,
                                                boolean _indexDelimiters,
                                                boolean _countDelimiters)

Method Detail

processTerm

public void processTerm(String t)

Description copied from interface: TermPipeline

Processes a term using the current term pipeline component and passes the output to the next pipeline component, if the term has not been discarded.

Specified by:

processTerm in interface TermPipeline

Parameters:

t - String the term to process.

reset

public boolean reset()

Description copied from interface: TermPipeline

This method implements the specific rest option needed to implements query or doc oriented policy.

Specified by:

reset in interface TermPipeline

Returns:

results of the operation