Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-296

Support indexing upgrading 3.x -> 4.x

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0
    • Component/s: None
    • Labels:
      None

      Description

      Thus far, the format of the bit indices for Terrier 3.x and 4.0 have not changed. We should make a generic properties file updater method that can be called from Index(OnDisk) that rewrites properties.

        Attachments

          Activity

          Hide
          craigm Craig Macdonald added a comment -

          Example data file:

          index.direct.class
          	org.terrier.structures.DirectIndex
          		org.terrier.structures.BitPostingIndex
          	org.terrier.structures.BlockDirectIndex
          		org.terrier.structures.BitPostingIndex
          index.inverted.class
          	org.terrier.structures.InvertedIndex
          		org.terrier.structures.BitPostingIndex
          	org.terrier.structures.BlockInvertedIndex
          		org.terrier.structures.BitPostingIndex
          
          
          Show
          craigm Craig Macdonald added a comment - Example data file: index.direct.class org.terrier.structures.DirectIndex org.terrier.structures.BitPostingIndex org.terrier.structures.BlockDirectIndex org.terrier.structures.BitPostingIndex index.inverted.class org.terrier.structures.InvertedIndex org.terrier.structures.BitPostingIndex org.terrier.structures.BlockInvertedIndex org.terrier.structures.BitPostingIndex
          Hide
          craigm Craig Macdonald added a comment -

          Also has to update the names of the IterablePosting classes used to read the various Bit structures.

          Show
          craigm Craig Macdonald added a comment - Also has to update the names of the IterablePosting classes used to read the various Bit structures.
          Hide
          richardm Richard McCreadie added a comment -

          Committed to r3841

          Relevant class is org.terrier.utility.restructure.Terrier4

          Show
          richardm Richard McCreadie added a comment - Committed to r3841 Relevant class is org.terrier.utility.restructure.Terrier4
          Hide
          richardm Richard McCreadie added a comment -

          IndexOnDisk now automatically checks to see if the Terrier version is 3.x, if so it runs org.terrier.utility.restructure.Terrier4.updateIndexProperties() first and then re-loads the properties.

          Committed to r3843

          Show
          richardm Richard McCreadie added a comment - IndexOnDisk now automatically checks to see if the Terrier version is 3.x, if so it runs org.terrier.utility.restructure.Terrier4.updateIndexProperties() first and then re-loads the properties. Committed to r3843
          Hide
          richardm Richard McCreadie added a comment -

          Merged with Craig's version 3844.

          Show
          richardm Richard McCreadie added a comment - Merged with Craig's version 3844.
          Hide
          richardm Richard McCreadie added a comment -

          Added OnDisk Unit tests and sample 3.x shakespeare indices.

          Committed r3846

          Show
          richardm Richard McCreadie added a comment - Added OnDisk Unit tests and sample 3.x shakespeare indices. Committed r3846

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: