uk.ac.gla.terrier.indexing
Class BlockIndexer

java.lang.Object
  uk.ac.gla.terrier.indexing.Indexer
      uk.ac.gla.terrier.indexing.BlockIndexer

public class BlockIndexer
extends Indexer

An indexer that saves block information for the indexed terms. Properties:

• block.size - How many terms should be in one block. If you want to use phrasal search, this need to be 1 (default).
• max.blocks - Maximum number of blocks in a document. After this number of blocks, all subsequent terms will be in the same block. Default 100,000
• block.indexing - This class should only be used if the block.indexing property is set.
• indexing.max.encoded.documentindex.docs - how many docs before the DocumentIndexEncoded is dropped in favour of the DocumentIndex (on disk implementation).
• string.use_utf - use the UTF index structures?
• See Also: Properties in uk.ac.gla.terrier.indexing.Indexer and uk.ac.gla.terrier.indexing.BasicIndexer

Version:

$Revision: 1.39 $

Author:

Craig Macdonald & Vassilis Plachouras

Constructor Summary

BlockIndexer(java.lang.String pathname)
Constructs an instance of this class, where the created data structures are stored in the given path.

BlockIndexer(java.lang.String pathname, java.lang.String prefix)
Constructs an instance of this class, where the created data structures are stored in the given path, with the given prefix on the filenames.

Method Summary

void	createDirectIndex(Collection[] collections) For the given collection, it iterates through the documents and creates the direct index, document index and lexicon, using information about blocks and possibly fields.
void	createInvertedIndex() Creates the inverted index from the already created direct index, document index and lexicon.

Methods inherited from class uk.ac.gla.terrier.indexing.Indexer

index, main, merge, merge

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BlockIndexer

public BlockIndexer(java.lang.String pathname)

Constructs an instance of this class, where the created data structures are stored in the given path.

Parameters:

pathname - String the path in which the created data structures will be saved.

BlockIndexer

public BlockIndexer(java.lang.String pathname,
                    java.lang.String prefix)

Constructs an instance of this class, where the created data structures are stored in the given path, with the given prefix on the filenames.

Parameters:

pathname - String the path in which the created data structures will be saved

prefix - String the prefix on the filenames of the created data structures

Method Detail

createDirectIndex

public void createDirectIndex(Collection[] collections)

For the given collection, it iterates through the documents and creates the direct index, document index and lexicon, using information about blocks and possibly fields.

Specified by:

createDirectIndex in class Indexer

Parameters:

collections - Collection[] the collection to index.

See Also:

Indexer.createDirectIndex(uk.ac.gla.terrier.indexing.Collection[])

createInvertedIndex

public void createInvertedIndex()

Creates the inverted index from the already created direct index, document index and lexicon. It saves block information and possibly field information as well.

Specified by:

createInvertedIndex in class Indexer

See Also:

Indexer.createInvertedIndex()