Package org.terrier.applications

Class BatchIndexing

java.lang.Object

org.terrier.applications.BatchIndexing

Direct Known Subclasses:

ThreadedBatchIndexing, TRECIndexing

public abstract class BatchIndexing
extends java.lang.Object

Abstract class for all code that set up the batch indexers

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	BatchIndexing.Command

Field Summary

Fields

Modifier and Type	Field	Description
protected boolean	blocks
protected java.lang.String	collectionClassName
protected java.util.List<java.lang.String>	collectionFiles
protected java.lang.String	collectionSpec
protected int	externalParalllism
protected static org.slf4j.Logger	logger	The logger used
protected java.lang.String	path
protected java.lang.String	prefix

Constructor Summary

Constructors

Constructor	Description
BatchIndexing(java.lang.String _path, java.lang.String _prefix)

Method Summary

Modifier and Type	Method	Description
int	getExternalParalllism()
abstract void	index()
protected Collection	loadCollection(java.lang.String collectionSpec)	open a collection when given the collection.spec name
protected Collection	loadCollection(java.util.List<java.lang.String> files)	open a collection when given a list of files
void	setCollectionName(java.lang.String collName)
void	setCollectionSpec(java.lang.String specFile)
void	setExternalParalllism(int externalParalllism)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

logger

protected static org.slf4j.Logger logger

The logger used

path

protected final java.lang.String path

prefix

protected final java.lang.String prefix

blocks

protected boolean blocks

collectionClassName

protected java.lang.String collectionClassName

collectionSpec

protected java.lang.String collectionSpec

collectionFiles

protected java.util.List<java.lang.String> collectionFiles

externalParalllism

protected int externalParalllism

Constructor Detail

BatchIndexing

public BatchIndexing(java.lang.String _path,
                     java.lang.String _prefix)

Method Detail

getExternalParalllism

public int getExternalParalllism()

setExternalParalllism

public void setExternalParalllism(int externalParalllism)

setCollectionName

public void setCollectionName(java.lang.String collName)

setCollectionSpec

public void setCollectionSpec(java.lang.String specFile)

index

public abstract void index()

loadCollection

protected Collection loadCollection(java.util.List<java.lang.String> files)

open a collection when given a list of files

loadCollection

protected Collection loadCollection(java.lang.String collectionSpec)

open a collection when given the collection.spec name