org.terrier.utility.io

Class HadoopUtility.MapReduceBase<K1,V1,K2,V2,K3,V3>

java.lang.Object

org.terrier.utility.io.HadoopUtility.MapReduceBase<K1,V1,K2,V2,K3,V3>

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<K1,V1,K2,V2>, org.apache.hadoop.mapred.Reducer<K2,V2,K3,V3>

Direct Known Subclasses:

Inv2DirectMultiReduce

Enclosing class:

HadoopUtility

public abstract static class HadoopUtility.MapReduceBase<K1,V1,K2,V2,K3,V3>
extends Object
implements org.apache.hadoop.mapred.Mapper<K1,V1,K2,V2>, org.apache.hadoop.mapred.Reducer<K2,V2,K3,V3>

Handy base class for MapReduce jobs.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.mapred.JobConf	jc

Constructor Summary

Constructors

Constructor and Description
HadoopUtility.MapReduceBase()

Method Summary

Methods

Modifier and Type	Method and Description
void	close() Called at end of map or reduce task.
protected abstract void	closeMap()
protected abstract void	closeReduce()
void	configure(org.apache.hadoop.mapred.JobConf _jc)
protected abstract void	configureMap()
protected abstract void	configureReduce()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.Mapper

map

Methods inherited from interface org.apache.hadoop.mapred.Reducer

reduce

Methods inherited from interface org.apache.hadoop.mapred.JobConfigurable

configure

Methods inherited from interface java.io.Closeable

close

Field Detail

jc

protected org.apache.hadoop.mapred.JobConf jc

Constructor Detail

HadoopUtility.MapReduceBase

public HadoopUtility.MapReduceBase()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf _jc)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

configureMap

protected abstract void configureMap()
                              throws IOException

Throws:

IOException

configureReduce

protected abstract void configureReduce()
                                 throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Called at end of map or reduce task. Calls internally closeMap() or closeReduce()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

closeMap

protected abstract void closeMap()
                          throws IOException

Throws:

IOException

closeReduce

protected abstract void closeReduce()
                             throws IOException

Throws:

IOException