Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-56

2Way StructureMerger - produces too large termids

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0
    • Fix Version/s: 3.0
    • Component/s: .structures
    • Labels:
      None

      Description

      junit.framework.AssertionFailedError: Got too big a termid (3867) from direct index input stream, numTerms=2361
      at junit.framework.Assert.fail(Assert.java:47)
      at junit.framework.Assert.assertTrue(Assert.java:20)
      at uk.ac.gla.terrier.tests.ShakespeareEndToEndTest.checkDirectIndex(ShakespeareEndToEndTest.java:219)
      at uk.ac.gla.terrier.tests.ShakespeareEndToEndTest.checkIndex(ShakespeareEndToEndTest.java:285)
      at uk.ac.gla.terrier.tests.BatchEndToEndTest.doTrecTerrierIndexingRunAndEvaluate(BatchEndToEndTest.java:157)
      at uk.ac.gla.terrier.tests.BasicShakespeareEndToEndTest.testBasicClassical(BasicShakespeareEndToEndTest.java:19)

        Attachments

          Activity

          Hide
          craigm Craig Macdonald added a comment -

          Problem is that in the inverted merging phase, old-termid -> new-termid mappings are produced for use when the direct index is being merged. However, the new termids may not have the same ordering as the old termids, so postings from the second direct file need to be reordered when being written to the first direct file.

          Show
          craigm Craig Macdonald added a comment - Problem is that in the inverted merging phase, old-termid -> new-termid mappings are produced for use when the direct index is being merged. However, the new termids may not have the same ordering as the old termids, so postings from the second direct file need to be reordered when being written to the first direct file.
          Hide
          craigm Craig Macdonald added a comment - - edited

          Fix committed to trunk. Very easy once the penny has dropped!

          Show
          craigm Craig Macdonald added a comment - - edited Fix committed to trunk. Very easy once the penny has dropped!
          Hide
          craigm Craig Macdonald added a comment -

          Meant to add that this issue is checked by the end-to-end tests.

          Show
          craigm Craig Macdonald added a comment - Meant to add that this issue is checked by the end-to-end tests.

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: