org.terrier.structures

Class FSOMapFileLexiconOutputStream

java.lang.Object

org.terrier.structures.LexiconOutputStream<T1>

org.terrier.structures.FSOMapFileLexiconOutputStreamGeneric<String,org.apache.hadoop.io.Text>

org.terrier.structures.FSOMapFileLexiconOutputStream

All Implemented Interfaces:

Closeable, AutoCloseable

public class FSOMapFileLexiconOutputStream
extends FSOMapFileLexiconOutputStreamGeneric<String,org.apache.hadoop.io.Text>

A LexiconOutputStream for FSOMapFileLexicon. Writes to a FSOrderedMapFile.

Since:

3.0

Author:

Craig Macdonald

Field Summary

Fields inherited from class org.terrier.structures.FSOMapFileLexiconOutputStreamGeneric

index, keyFactory, leValueClassname, mapFileWriter, structureName, tempKey

Fields inherited from class org.terrier.structures.LexiconOutputStream

lexiconStream, numPointersWritten, numTermsWritten, numTokensWritten

Constructor Summary

Constructors

Constructor and Description
FSOMapFileLexiconOutputStream(IndexOnDisk _index, String _structureName, Class<? extends FixedSizeWriteableFactory<LexiconEntry>> valueFactoryClass)
FSOMapFileLexiconOutputStream(IndexOnDisk _index, String _structureName, FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory, Class<? extends FixedSizeWriteableFactory<LexiconEntry>> valueFactoryClass)
FSOMapFileLexiconOutputStream(IndexOnDisk _index, String _structureName, FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory, String valueFactoryClassName)
FSOMapFileLexiconOutputStream(String filename, FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory)
FSOMapFileLexiconOutputStream(String path, String prefix, String _structureName, FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory)

Method Summary

Modifier and Type	Method and Description
static void	addLexiconToIndex(IndexOnDisk index, String structureName, String leValueClassname) Adds Lexicon to index
void	close() Closes the lexicon stream.
protected void	setKey(String k)

Methods inherited from class org.terrier.structures.FSOMapFileLexiconOutputStreamGeneric

addLexiconToIndex, writeNextEntry

Methods inherited from class org.terrier.structures.LexiconOutputStream

getNumberOfPointersWritten, getNumberOfTermsWritten, getNumberOfTokensWritten, incrementCounters

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FSOMapFileLexiconOutputStream

public FSOMapFileLexiconOutputStream(IndexOnDisk _index,
                                     String _structureName,
                                     Class<? extends FixedSizeWriteableFactory<LexiconEntry>> valueFactoryClass)
                              throws IOException

Throws:

IOException

FSOMapFileLexiconOutputStream

public FSOMapFileLexiconOutputStream(IndexOnDisk _index,
                                     String _structureName,
                                     FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory,
                                     Class<? extends FixedSizeWriteableFactory<LexiconEntry>> valueFactoryClass)
                              throws IOException

Throws:

IOException

FSOMapFileLexiconOutputStream

public FSOMapFileLexiconOutputStream(IndexOnDisk _index,
                                     String _structureName,
                                     FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory,
                                     String valueFactoryClassName)
                              throws IOException

Throws:

IOException

FSOMapFileLexiconOutputStream

public FSOMapFileLexiconOutputStream(String filename,
                                     FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory)
                              throws IOException

Throws:

IOException

FSOMapFileLexiconOutputStream

public FSOMapFileLexiconOutputStream(String path,
                                     String prefix,
                                     String _structureName,
                                     FixedSizeWriteableFactory<org.apache.hadoop.io.Text> _keyFactory)
                              throws IOException

Throws:

IOException

Method Detail

setKey

protected void setKey(String k)

Specified by:

setKey in class FSOMapFileLexiconOutputStreamGeneric<String,org.apache.hadoop.io.Text>

close

public void close()

Description copied from class: LexiconOutputStream

Closes the lexicon stream. IOException if an I/O error occurs while closing the stream.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class FSOMapFileLexiconOutputStreamGeneric<String,org.apache.hadoop.io.Text>

addLexiconToIndex

public static void addLexiconToIndex(IndexOnDisk index,
                                     String structureName,
                                     String leValueClassname)

Adds Lexicon to index

Parameters:

index -

structureName -

leValueClassname -