Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-56

2Way StructureMerger - produces too large termids

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 3.0
          • Fix Version/s: 3.0
          • Component/s: .structures
          • Labels:
            None

            Description

            junit.framework.AssertionFailedError: Got too big a termid (3867) from direct index input stream, numTerms=2361
            at junit.framework.Assert.fail(Assert.java:47)
            at junit.framework.Assert.assertTrue(Assert.java:20)
            at uk.ac.gla.terrier.tests.ShakespeareEndToEndTest.checkDirectIndex(ShakespeareEndToEndTest.java:219)
            at uk.ac.gla.terrier.tests.ShakespeareEndToEndTest.checkIndex(ShakespeareEndToEndTest.java:285)
            at uk.ac.gla.terrier.tests.BatchEndToEndTest.doTrecTerrierIndexingRunAndEvaluate(BatchEndToEndTest.java:157)
            at uk.ac.gla.terrier.tests.BasicShakespeareEndToEndTest.testBasicClassical(BasicShakespeareEndToEndTest.java:19)

              Attachments

                Activity

                Ascending order - Click to sort in descending order
                Hide
                Permalink
                craigm Craig Macdonald added a comment -

                Problem is that in the inverted merging phase, old-termid -> new-termid mappings are produced for use when the direct index is being merged. However, the new termids may not have the same ordering as the old termids, so postings from the second direct file need to be reordered when being written to the first direct file.

                Show
                craigm Craig Macdonald added a comment - Problem is that in the inverted merging phase, old-termid -> new-termid mappings are produced for use when the direct index is being merged. However, the new termids may not have the same ordering as the old termids, so postings from the second direct file need to be reordered when being written to the first direct file.
                Hide
                Permalink
                craigm Craig Macdonald added a comment - - edited

                Fix committed to trunk. Very easy once the penny has dropped!

                Show
                craigm Craig Macdonald added a comment - - edited Fix committed to trunk. Very easy once the penny has dropped!
                Hide
                Permalink
                craigm Craig Macdonald added a comment -

                Meant to add that this issue is checked by the end-to-end tests.

                Show
                craigm Craig Macdonald added a comment - Meant to add that this issue is checked by the end-to-end tests.

                  People

                  • Assignee:
                    craigm Craig Macdonald
                    Reporter:
                    craigm Craig Macdonald
                  • Watchers:
                    0 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: