Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-357

Target non-forked version of Java_FastPFOR

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 4.0
    • Fix Version/s: 4.1
    • Component/s: None
    • Labels:
      None

      Description

      the JavaFastPFOR version that we used compresses an array of N integers storing the value N into the compressed output OUT. At decompression time, the library takes OUT as a parameter and decompresses it using the N value stored into OUT.
      We compress a posting list in blocks, which have a fixed size (e.g., 1024 postings). Also, we know the posting list length. So, storing N into OUT was unnecessary.
      After ECIR'14, Lemire added a new interface to his library, which exactly addresses this aspect:
      https://github.com/lemire/JavaFastPFOR/blob/master/src/main/java/me/lemire/integercompression/SkippableIntegerCODEC.java

      (as said be Matteo Catena)

        Attachments

          Activity

          craigm Craig Macdonald created issue -
          Hide
          craigm Craig Macdonald added a comment -

          Committed r4019

          Show
          craigm Craig Macdonald added a comment - Committed r4019
          craigm Craig Macdonald made changes -
          Field Original Value New Value
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          richardm Richard McCreadie made changes -
          Project TREC [ 10010 ] Terrier Core [ 10000 ]
          Key TREC-418 TR-357
          Workflow jira [ 10929 ] Terrier Open Source [ 10961 ]
          Affects Version/s 4.0 [ 10051 ]
          Affects Version/s 4.0 [ 10050 ]
          Component/s Core [ 10020 ]
          Fix Version/s 4.1 [ 10070 ]
          Fix Version/s 4.1 [ 10071 ]

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: