org.terrier.applications

Class InvertedIndexRecompresser

java.lang.Object

org.terrier.applications.CLITool

org.terrier.applications.InvertedIndexRecompresser

public class InvertedIndexRecompresser
extends CLITool

NOTE: BE CAREFUL, THIS APPLICATION OVERWRITES THE INDEX!! This application recompress an inverted index using the specified compression configuration. Usage: InvertedIndexRecompresser The terrier.properties must contain the following properties: indexing.tmp-inverted.compression.configuration=IntegerCodecCompressionConfiguration e.g. indexing.tmp-inverted.compression.configuration=IntegerCodecCompressionConfiguration If you are targetting IntegerCodecCompressionConfiguration, you probably need the following properties: compression.integer.chunk.size=N compression.tmp-inverted.integer.ids.codec=the IntegerCodec to use to compress ids compression.tmp-inverted.integer.ids.codec=the IntegerCodec to use to compress tfs compression.tmp-inverted.integer.ids.codec=the IntegerCodec to use to compress fields (if any) compression.tmp-inverted.integer.ids.codec=the IntegerCodec to use to compress blocks (if any) For example: compression.tmp-inverted.integer.ids.codec=LemireFastPFORVBCodec compression.tmp-inverted.integer.tfs.codec=LemireFastPFORVBCodec compression.tmp-inverted.integer.fields.codec=LemireFastPFORVBCodec compression.tmp-inverted.integer.blocks.codec=LemireFastPFORVBCodec indexing.tmp-inverted.compression.configuration=IntegerCodecCompressionConfiguration compression.integer.chunk.size=1024 NOTE: BE CAREFUL, THIS APPLICATION OVERWRITES THE INDEX!!

Since:

4.0

Author:

Matteo Catena, Craig Macdonald

Nested Class Summary

Nested classes/interfaces inherited from class org.terrier.applications.CLITool

CLITool.CLIParsedCLITool, CLITool.HelpAliasCLITool, CLITool.HelpCLITool

Field Summary

Fields inherited from class org.terrier.applications.CLITool

PLATFORM_MODULE, POPULAR_COMMANDS

Constructor Summary

Constructors

Constructor and Description
InvertedIndexRecompresser()

Method Summary

Modifier and Type	Method and Description
String	commandname() What commandname should this command respond to
String	help() Return a long message about how to use this command
String	helpsummary() Returns a short sentence about what this command is for
static void	main(String[] args)
static void	recompressInverted(IndexOnDisk index)
int	run(String[] args)
String	sourcepackage()

Methods inherited from class org.terrier.applications.CLITool

commandaliases, run, run, setConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InvertedIndexRecompresser

public InvertedIndexRecompresser()

Method Detail

run

public int run(String[] args)

Specified by:

run in class CLITool

commandname

public String commandname()

Description copied from class: CLITool

What commandname should this command respond to

Overrides:

commandname in class CLITool

help

public String help()

Description copied from class: CLITool

Return a long message about how to use this command

Overrides:

help in class CLITool

sourcepackage

public String sourcepackage()

Overrides:

sourcepackage in class CLITool

helpsummary

public String helpsummary()

Description copied from class: CLITool

Returns a short sentence about what this command is for

Overrides:

helpsummary in class CLITool

recompressInverted

public static void recompressInverted(IndexOnDisk index)
                               throws Exception

Throws:

Exception

main

public static void main(String[] args)