Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-296

Support indexing upgrading 3.x -> 4.x

          Details

          • Type: Task
          • Status: Resolved
          • Priority: Blocker
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 4.0
          • Component/s: None
          • Labels:
            None

            Description

            Thus far, the format of the bit indices for Terrier 3.x and 4.0 have not changed. We should make a generic properties file updater method that can be called from Index(OnDisk) that rewrites properties.

              Attachments

                Activity

                Ascending order - Click to sort in descending order
                Hide
                Permalink
                craigm Craig Macdonald added a comment -

                Example data file:

                index.direct.class
	org.terrier.structures.DirectIndex
		org.terrier.structures.BitPostingIndex
	org.terrier.structures.BlockDirectIndex
		org.terrier.structures.BitPostingIndex
index.inverted.class
	org.terrier.structures.InvertedIndex
		org.terrier.structures.BitPostingIndex
	org.terrier.structures.BlockInvertedIndex
		org.terrier.structures.BitPostingIndex
                Show
                craigm Craig Macdonald added a comment - Example data file: index.direct.class org.terrier.structures.DirectIndex org.terrier.structures.BitPostingIndex org.terrier.structures.BlockDirectIndex org.terrier.structures.BitPostingIndex index.inverted.class org.terrier.structures.InvertedIndex org.terrier.structures.BitPostingIndex org.terrier.structures.BlockInvertedIndex org.terrier.structures.BitPostingIndex
                Hide
                Permalink
                craigm Craig Macdonald added a comment -

                Also has to update the names of the IterablePosting classes used to read the various Bit structures.

                Show
                craigm Craig Macdonald added a comment - Also has to update the names of the IterablePosting classes used to read the various Bit structures.
                Hide
                Permalink
                richardm Richard McCreadie added a comment -

                Committed to r3841

                Relevant class is org.terrier.utility.restructure.Terrier4

                Show
                richardm Richard McCreadie added a comment - Committed to r3841 Relevant class is org.terrier.utility.restructure.Terrier4
                Hide
                Permalink
                richardm Richard McCreadie added a comment -

                IndexOnDisk now automatically checks to see if the Terrier version is 3.x, if so it runs org.terrier.utility.restructure.Terrier4.updateIndexProperties() first and then re-loads the properties.

                Committed to r3843

                Show
                richardm Richard McCreadie added a comment - IndexOnDisk now automatically checks to see if the Terrier version is 3.x, if so it runs org.terrier.utility.restructure.Terrier4.updateIndexProperties() first and then re-loads the properties. Committed to r3843
                Hide
                Permalink
                richardm Richard McCreadie added a comment -

                Merged with Craig's version 3844.

                Show
                richardm Richard McCreadie added a comment - Merged with Craig's version 3844.
                Hide
                Permalink
                richardm Richard McCreadie added a comment -

                Added OnDisk Unit tests and sample 3.x shakespeare indices.

                Committed r3846

                Show
                richardm Richard McCreadie added a comment - Added OnDisk Unit tests and sample 3.x shakespeare indices. Committed r3846

                  People

                  • Assignee:
                    craigm Craig Macdonald
                    Reporter:
                    craigm Craig Macdonald
                  • Watchers:
                    0 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: