org.terrier.structures.collections
Class FSOrderedMapFile.MultiFSOMapWriter

java.lang.Object
  org.terrier.structures.collections.FSOrderedMapFile.MultiFSOMapWriter

All Implemented Interfaces:

Closeable, Flushable, FSOrderedMapFile.MapFileWriter

Enclosing class:

FSOrderedMapFile<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

public static class FSOrderedMapFile.MultiFSOMapWriter
extends Object
implements FSOrderedMapFile.MapFileWriter, Flushable

Writes out a FSOMapFile, but assumes that input data need not be sorted by key.

Field Summary

protected FixedSizeWriteableFactory	keyFactory
protected FixedSizeWriteableFactory	valueFactory

Constructor Summary

FSOrderedMapFile.MultiFSOMapWriter(String filename, int numberOfValuesInMemory, FixedSizeWriteableFactory _keyFactory, FixedSizeWriteableFactory _valueFactory)
Constructs an instance of the MultiFSOMapWriter.

FSOrderedMapFile.MultiFSOMapWriter(String filename, int numberOfValuesInMemory, FixedSizeWriteableFactory _keyFactory, FixedSizeWriteableFactory _valueFactory, boolean dupsAllows)
Constructs an instance of the MultiFSOMapWriter.

Method Summary

void	close()
void	flush()
protected void	flushCache()
protected void	mergeTwo(int id1, int id2, String filename)
void	write(org.apache.hadoop.io.WritableComparable key, org.apache.hadoop.io.Writable value) Add this (key, value) tuple to the MapFile

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

keyFactory

protected FixedSizeWriteableFactory keyFactory

valueFactory

protected FixedSizeWriteableFactory valueFactory

Constructor Detail

FSOrderedMapFile.MultiFSOMapWriter

public FSOrderedMapFile.MultiFSOMapWriter(String filename,
                                          int numberOfValuesInMemory,
                                          FixedSizeWriteableFactory _keyFactory,
                                          FixedSizeWriteableFactory _valueFactory)

Constructs an instance of the MultiFSOMapWriter.

Parameters:

filename -

numberOfValuesInMemory -

_keyFactory -

_valueFactory -

FSOrderedMapFile.MultiFSOMapWriter

public FSOrderedMapFile.MultiFSOMapWriter(String filename,
                                          int numberOfValuesInMemory,
                                          FixedSizeWriteableFactory _keyFactory,
                                          FixedSizeWriteableFactory _valueFactory,
                                          boolean dupsAllows)

Constructs an instance of the MultiFSOMapWriter.

Parameters:

filename -

numberOfValuesInMemory -

_keyFactory -

_valueFactory -

dupsAllows - are duplicates allowed

Method Detail

write

public void write(org.apache.hadoop.io.WritableComparable key,
                  org.apache.hadoop.io.Writable value)
           throws IOException

Add this (key, value) tuple to the MapFile

Specified by:

write in interface FSOrderedMapFile.MapFileWriter

Throws:

IOException

flush

public void flush()
           throws IOException

Specified by:

flush in interface Flushable

Throws:

IOException

flushCache

protected void flushCache()
                   throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Throws:

IOException

mergeTwo

protected void mergeTwo(int id1,
                        int id2,
                        String filename)
                 throws IOException

Throws:

IOException