Package org.terrier.structures.indexing.singlepass

Class BlockSinglePassIndexer.DelimTermProcessor

  • All Implemented Interfaces:
    TermPipeline
    Enclosing class:
    BlockSinglePassIndexer
    protected class BlockSinglePassIndexer.DelimTermProcessor
extends java.lang.Object
implements TermPipeline
    This class behaves in a similar fashion to BasicTermProcessor except that this one treats blocks bounded by delimiters instead of fixed-sized blocks.
    Since:
    2.2
    Author:
    Rodrygo Santos

    • Constructor Summary

      Constructors 
      Constructor Description
      DelimTermProcessor​(java.lang.String[] _delims, boolean _indexDelimiters, boolean _countDelimiters)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void processTerm​(java.lang.String t)
      Processes a term using the current term pipeline component and passes the output to the next pipeline component, if the term has not been discarded.
      boolean reset()
      This method implements the specific rest option needed to implements query or doc oriented policy.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Field Detail

      • blockDelimiterTerms

        protected gnu.trove.THashSet<java.lang.String> blockDelimiterTerms

      • indexDelimiters

        protected final boolean indexDelimiters

      • countDelimiters

        protected final boolean countDelimiters

    • Constructor Detail

      • DelimTermProcessor

        public DelimTermProcessor​(java.lang.String[] _delims,
                          boolean _indexDelimiters,
                          boolean _countDelimiters)

    • Method Detail

      • processTerm

        public void processTerm​(java.lang.String t)
        Description copied from interface: TermPipeline
        Processes a term using the current term pipeline component and passes the output to the next pipeline component, if the term has not been discarded.
        Specified by:
        processTerm in interface TermPipeline
        Parameters:
        t - String the term to process.

      • reset

        public boolean reset()
        Description copied from interface: TermPipeline
        This method implements the specific rest option needed to implements query or doc oriented policy.
        Specified by:
        reset in interface TermPipeline
        Returns:
        results of the operation