Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-48

Field indexing is reported to not be correct.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0
    • Fix Version/s: 3.0
    • Component/s: .indexing, .structures
    • Labels:
      None

      Description

      Field indexing had various problems.

        Attachments

          Activity

          craigm Craig Macdonald created issue -
          Hide
          craigm Craig Macdonald added a comment -

          Richard, can you add your comment again?

          Thanks

          Show
          craigm Craig Macdonald added a comment - Richard, can you add your comment again? Thanks
          craigm Craig Macdonald made changes -
          Field Original Value New Value
          Link This issue relates to TREC-91 [ TREC-91 ]
          Hide
          craigm Craig Macdonald added a comment -

          This patch is ready to be committed. Here are the list of files affected:

          src/uk/ac/gla/terrier/indexing/BasicSinglePassIndexer.java
          src/uk/ac/gla/terrier/indexing/BlockSinglePassIndexer.java
          src/uk/ac/gla/terrier/indexing/hadoop/Hadoop_BasicSinglePassIndexer.java
          src/uk/ac/gla/terrier/indexing/hadoop/Hadoop_BlockSinglePassIndexer.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation0.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation1.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation2.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation2exp.java
          src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation3.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationB.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationF.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationJ.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationJN.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationP.java
          src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationStatic.java
          src/uk/ac/gla/terrier/structures/CollectionStatistics.java
          src/uk/ac/gla/terrier/structures/FieldDocumentIndexEntry.java
          src/uk/ac/gla/terrier/structures/FieldLexiconEntry.java
          src/uk/ac/gla/terrier/structures/FSOMapFileLexicon.java
          src/uk/ac/gla/terrier/structures/Index.java
          src/uk/ac/gla/terrier/structures/indexing/FieldDocumentPostingList.java
          src/uk/ac/gla/terrier/structures/indexing/FieldLexiconMap.java
          src/uk/ac/gla/terrier/structures/indexing/LexiconBuilder.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/BlockFieldPostingInRun.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/BlockInverted2DirectIndexBuilder.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/FieldPosting.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/FieldPostingInRun.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/FileRunIterator.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/FileRunIteratorFactory.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/Inverted2DirectIndexBuilder.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/Posting.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/RunIterator.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/RunIteratorFactory.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/HadoopRunIteratorFactory.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/HadoopRunPostingIterator.java
          src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/Inv2DirectMultiReduce.java
          src_test/uk/ac/gla/terrier/tests/BasicShakespeareEndToEndTest.java
          
          Show
          craigm Craig Macdonald added a comment - This patch is ready to be committed. Here are the list of files affected: src/uk/ac/gla/terrier/indexing/BasicSinglePassIndexer.java src/uk/ac/gla/terrier/indexing/BlockSinglePassIndexer.java src/uk/ac/gla/terrier/indexing/hadoop/Hadoop_BasicSinglePassIndexer.java src/uk/ac/gla/terrier/indexing/hadoop/Hadoop_BlockSinglePassIndexer.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation0.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation1.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation2.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation2exp.java src/uk/ac/gla/terrier/matching/models/normalisation/Normalisation3.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationB.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationF.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationJ.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationJN.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationP.java src/uk/ac/gla/terrier/matching/models/normalisation/NormalisationStatic.java src/uk/ac/gla/terrier/structures/CollectionStatistics.java src/uk/ac/gla/terrier/structures/FieldDocumentIndexEntry.java src/uk/ac/gla/terrier/structures/FieldLexiconEntry.java src/uk/ac/gla/terrier/structures/FSOMapFileLexicon.java src/uk/ac/gla/terrier/structures/Index.java src/uk/ac/gla/terrier/structures/indexing/FieldDocumentPostingList.java src/uk/ac/gla/terrier/structures/indexing/FieldLexiconMap.java src/uk/ac/gla/terrier/structures/indexing/LexiconBuilder.java src/uk/ac/gla/terrier/structures/indexing/singlepass/BlockFieldPostingInRun.java src/uk/ac/gla/terrier/structures/indexing/singlepass/BlockInverted2DirectIndexBuilder.java src/uk/ac/gla/terrier/structures/indexing/singlepass/FieldPosting.java src/uk/ac/gla/terrier/structures/indexing/singlepass/FieldPostingInRun.java src/uk/ac/gla/terrier/structures/indexing/singlepass/FileRunIterator.java src/uk/ac/gla/terrier/structures/indexing/singlepass/FileRunIteratorFactory.java src/uk/ac/gla/terrier/structures/indexing/singlepass/Inverted2DirectIndexBuilder.java src/uk/ac/gla/terrier/structures/indexing/singlepass/Posting.java src/uk/ac/gla/terrier/structures/indexing/singlepass/RunIterator.java src/uk/ac/gla/terrier/structures/indexing/singlepass/RunIteratorFactory.java src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/HadoopRunIteratorFactory.java src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/HadoopRunPostingIterator.java src/uk/ac/gla/terrier/structures/indexing/singlepass/hadoop/Inv2DirectMultiReduce.java src_test/uk/ac/gla/terrier/tests/BasicShakespeareEndToEndTest.java
          craigm Craig Macdonald made changes -
          Summary Block Field indexing is reported to not be correct. Field indexing is reported to not be correct.
          Description Recreating an issue that got lost when the DB was restored. Field indexing had various problems.
          craigm Craig Macdonald made changes -
          Assignee Iadh Ounis [ ounis ] Craig Macdonald [ craigm ]
          Hide
          craigm Craig Macdonald added a comment -

          Committed to trunk.

          Show
          craigm Craig Macdonald added a comment - Committed to trunk.
          craigm Craig Macdonald made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          craigm Craig Macdonald made changes -
          Affects Version/s 3.0 [ 10020 ]
          Fix Version/s 3.0 [ 10020 ]
          craigm Craig Macdonald made changes -
          Project TREC [ 10010 ] Terrier Core [ 10000 ]
          Key TREC-50 TR-48
          Workflow jira [ 10125 ] Terrier Open Source [ 10306 ]
          Affects Version/s 3.0 [ 10030 ]
          Affects Version/s 3.0 [ 10020 ]
          Component/s .indexing [ 10002 ]
          Component/s .structures [ 10007 ]
          Component/s Core [ 10020 ]
          Component/s TREC2009 [ 10033 ]
          Fix Version/s 3.0 [ 10030 ]
          Fix Version/s 3.0 [ 10020 ]

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: