Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-290

Integer compression properties should be more uniform with others

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Minor
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 4.0
          • Component/s: None
          • Labels:
            None

            Description

            See
            http://terrier.org/issues/browse/TREC-334?focusedCommentId=11434&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_11434

            Various places also need to change:
             - unit tests
             - and IntegerCodecCompressionConfiguration

              Attachments

                Issue Links

                relates to

                New Feature - A new feature of the product, which has yet to be developed. TR-311 New integer compression techniques for the direct and inverted index structures

                • Major - Major loss of function.
                • Resolved

                  Activity

                  Ascending order - Click to sort in descending order
                  Hide
                  Permalink
                  richardm Richard McCreadie added a comment -

                  Index recompressor needs to change too

                  Show
                  richardm Richard McCreadie added a comment - Index recompressor needs to change too
                  Hide
                  Permalink
                  richardm Richard McCreadie added a comment -

                  indexing.direct.compression.configuration and indexing.inverted.compression.configuration are the main compression configuration properties.

                  E.g.

                  #this property is ok
indexing.direct.compression.configuration=org.terrier.structures.integer.indexing.IntegerCodecCompressionConfiguration
#these properties should be renamed indexing.inverted.compression.integer....
compression.inverted.integer.ids.codec=LemireFORVBCodec
compression.inverted.integer.tfs.codec=LemireFORVBCodec
compression.inverted.integer.fields.codec=LemireFORVBCodec
compression.inverted.integer.blocks.codec=LemireFORVBCodec
#this property should be specific to the structure also
compression.integer.chunk.size=1024
                  Show
                  richardm Richard McCreadie added a comment - indexing.direct.compression.configuration and indexing.inverted.compression.configuration are the main compression configuration properties. E.g. #this property is ok indexing.direct.compression.configuration=org.terrier.structures.integer.indexing.IntegerCodecCompressionConfiguration #these properties should be renamed indexing.inverted.compression.integer.... compression.inverted.integer.ids.codec=LemireFORVBCodec compression.inverted.integer.tfs.codec=LemireFORVBCodec compression.inverted.integer.fields.codec=LemireFORVBCodec compression.inverted.integer.blocks.codec=LemireFORVBCodec #this property should be specific to the structure also compression.integer.chunk.size=1024
                  Hide
                  Permalink
                  richardm Richard McCreadie added a comment - - edited

                  Switched format slightly (indexing->index) to make it consistent with existing properties where appropriate:

                  indexing.structureName.compression.configuration=IntegerCodecCompressionConfiguration

                  index.structureName.compression.integer.ids.codec=LemireFORVBCodec
                  index.structureName.compression.integer.tfs.codec=LemireFORVBCodec
                  index.structureName.compression.integer.fields.codec=LemireFORVBCodec
                  index.structureName.compression.integer.blocks.codec=LemireFORVBCodec
                  index.structureName.compression.integer.chunk.size=1024

                  Show
                  richardm Richard McCreadie added a comment - - edited Switched format slightly (indexing->index) to make it consistent with existing properties where appropriate: indexing.structureName.compression.configuration=IntegerCodecCompressionConfiguration index.structureName.compression.integer.ids.codec=LemireFORVBCodec index.structureName.compression.integer.tfs.codec=LemireFORVBCodec index.structureName.compression.integer.fields.codec=LemireFORVBCodec index.structureName.compression.integer.blocks.codec=LemireFORVBCodec index.structureName.compression.integer.chunk.size=1024
                  Hide
                  Permalink
                  richardm Richard McCreadie added a comment -

                  Committed r3868

                  Show
                  richardm Richard McCreadie added a comment - Committed r3868

                    People

                    • Assignee:
                      richardm Richard McCreadie
                      Reporter:
                      craigm Craig Macdonald
                    • Watchers:
                      0 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: