Package org.terrier.structures.indexing

Class ZstdMetaIndexBuilder

java.lang.Object

org.terrier.structures.indexing.MetaIndexBuilder

org.terrier.structures.indexing.BaseMetaIndexBuilder

org.terrier.structures.indexing.ZstdMetaIndexBuilder

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable

public class ZstdMetaIndexBuilder
extends BaseMetaIndexBuilder

Writes all metadata using Zstandard compression.

Since:

5.5

Field Summary

Fields inherited from class org.terrier.structures.indexing.BaseMetaIndexBuilder

baos, compressedBuffer, CROP_LONG, currentIndexOffset, currentOffset, dataOutput, DOCS_PER_CHECK, entryCount, entryLengthBytes, index, indexOutput, key2Index, keyCount, keyFactories, keyNames, lastValues, logger, MAX_INDEX_MB_IN_MEM_RETRIEVAL, MAX_MB_IN_MEM_RETRIEVAL, memCheck, REVERSE_ALLOW_DUPS, REVERSE_KEY_LOOKUP_WRITING_BUFFER_SIZE, reverseKeyNames, reverseKeys, reverseWriters, spaces, structureClass, structureInputStreamClass, structureName, valueLensBytes, valueLensChars, valuesSorted

Constructor Summary

Constructors

Constructor	Description
ZstdMetaIndexBuilder(IndexOnDisk _index, java.lang.String[] _keyNames, int[] _valueLens, java.lang.String[] _reverseKeys)
ZstdMetaIndexBuilder(IndexOnDisk _index, java.lang.String _structureName, java.lang.String[] _keyNames, int[] _valueLens, java.lang.String[] _reverseKeys)

Method Summary

Modifier and Type	Method	Description
protected int	writeData(byte[] data)

Methods inherited from class org.terrier.structures.indexing.BaseMetaIndexBuilder

close, flush, writeDocumentEntry, writeDocumentEntry

Methods inherited from class org.terrier.structures.indexing.MetaIndexBuilder

create

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ZstdMetaIndexBuilder

public ZstdMetaIndexBuilder(IndexOnDisk _index,
                            java.lang.String[] _keyNames,
                            int[] _valueLens,
                            java.lang.String[] _reverseKeys)

ZstdMetaIndexBuilder

public ZstdMetaIndexBuilder(IndexOnDisk _index,
                            java.lang.String _structureName,
                            java.lang.String[] _keyNames,
                            int[] _valueLens,
                            java.lang.String[] _reverseKeys)

Method Detail

writeData

protected int writeData(byte[] data)
                 throws java.io.IOException

Specified by:

writeData in class BaseMetaIndexBuilder

Throws:

java.io.IOException