|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use MapEmittedPostingList | |
---|---|
org.terrier.indexing.hadoop | Provides classes for Terrier's MapReduce indexer. |
org.terrier.structures.indexing.singlepass.hadoop | Provides classes implemeting the Hadoop MapReduce indexing in Terrier. |
Uses of MapEmittedPostingList in org.terrier.indexing.hadoop |
---|
Fields in org.terrier.indexing.hadoop with type parameters of type MapEmittedPostingList | |
---|---|
protected org.apache.hadoop.mapred.OutputCollector<SplitEmittedTerm,MapEmittedPostingList> |
Hadoop_BasicSinglePassIndexer.outputPostingListCollector
output collector for the current map indexing process |
Method parameters in org.terrier.indexing.hadoop with type arguments of type MapEmittedPostingList | |
---|---|
void |
Hadoop_BasicSinglePassIndexer.map(org.apache.hadoop.io.Text key,
SplitAwareWrapper<Document> value,
org.apache.hadoop.mapred.OutputCollector<SplitEmittedTerm,MapEmittedPostingList> _outputPostingListCollector,
org.apache.hadoop.mapred.Reporter reporter)
Map processes a single document. |
void |
Hadoop_BasicSinglePassIndexer.reduce(SplitEmittedTerm Term,
java.util.Iterator<MapEmittedPostingList> postingIterator,
org.apache.hadoop.mapred.OutputCollector<java.lang.Object,java.lang.Object> output,
org.apache.hadoop.mapred.Reporter reporter)
Main reduce algorithm step. |
Uses of MapEmittedPostingList in org.terrier.structures.indexing.singlepass.hadoop |
---|
Fields in org.terrier.structures.indexing.singlepass.hadoop with type parameters of type MapEmittedPostingList | |
---|---|
protected org.apache.hadoop.mapred.OutputCollector<SplitEmittedTerm,MapEmittedPostingList> |
HadoopRunWriter.outputCollector
output collector of Map task |
protected java.util.Iterator<MapEmittedPostingList> |
HadoopRunPostingIterator.postingIterator
Runs To Be Merged |
Methods in org.terrier.structures.indexing.singlepass.hadoop that return MapEmittedPostingList | |
---|---|
static MapEmittedPostingList |
MapEmittedPostingList.create_Hadoop_WritableRunPostingData(byte[] postingList,
int DocumentFreq,
int TermFreq)
Super Factory Method |
static MapEmittedPostingList |
MapEmittedPostingList.create_Hadoop_WritableRunPostingData(java.lang.String mapTaskID,
int flushNo,
int splitNo,
byte[] postingList,
int DocumentFreq,
int TermFreq)
Factory Method |
Methods in org.terrier.structures.indexing.singlepass.hadoop with parameters of type MapEmittedPostingList | |
---|---|
int |
SplitEmittedTerm.SETPartitioner.getPartition(SplitEmittedTerm term,
MapEmittedPostingList posting,
int numPartitions)
Retuns the partition for the specified term and posting list, given the specified number of partitions. |
int |
SplitEmittedTerm.SETPartitionerLowercaseAlphaTerm.getPartition(SplitEmittedTerm term,
MapEmittedPostingList posting,
int numPartitions)
Retuns the partition for the specified term and posting list, given the specified number of partitions. |
Method parameters in org.terrier.structures.indexing.singlepass.hadoop with type arguments of type MapEmittedPostingList | |
---|---|
void |
HadoopRunIteratorFactory.setRunPostingIterator(java.util.Iterator<MapEmittedPostingList> _postingIterator)
Update the posting iterator currently being used |
Constructor parameters in org.terrier.structures.indexing.singlepass.hadoop with type arguments of type MapEmittedPostingList | |
---|---|
HadoopRunIteratorFactory(java.util.Iterator<MapEmittedPostingList> _postingIterator,
java.lang.Class<? extends PostingInRun> _postingClass,
int numberOfFields)
constructor |
|
HadoopRunPostingIterator(java.lang.Class<? extends PostingInRun> postingClass,
int runNo,
java.util.Iterator<MapEmittedPostingList> _postingiterator,
java.lang.String _term,
int numFields)
Constructs a new RunPostingIterator. |
|
HadoopRunWriter(org.apache.hadoop.mapred.OutputCollector<SplitEmittedTerm,MapEmittedPostingList> _outputCollector,
java.lang.String _mapId,
int _splitId,
int _flushNo)
Create a new HadoopRunWriter, specifying the output collector of the map task the run number and the flush number. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |