Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-357

Target non-forked version of Java_FastPFOR

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 4.0
    • Fix Version/s: 4.1
    • Component/s: None
    • Labels:
      None

      Description

      the JavaFastPFOR version that we used compresses an array of N integers storing the value N into the compressed output OUT. At decompression time, the library takes OUT as a parameter and decompresses it using the N value stored into OUT.
      We compress a posting list in blocks, which have a fixed size (e.g., 1024 postings). Also, we know the posting list length. So, storing N into OUT was unnecessary.
      After ECIR'14, Lemire added a new interface to his library, which exactly addresses this aspect:
      https://github.com/lemire/JavaFastPFOR/blob/master/src/main/java/me/lemire/integercompression/SkippableIntegerCODEC.java

      (as said be Matteo Catena)

        Attachments

          Activity

          Hide
          craigm Craig Macdonald added a comment -

          Committed r4019

          Show
          craigm Craig Macdonald added a comment - Committed r4019

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: