Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-373

mAP scores in quickstart.html do not match Terrier 4.1 output

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: 4.2
    • Component/s: .evaluation
    • Labels:
      None

      Description

      To replicate index WT2G trec collection and perform retrieval using topics 401-450

      Should be: 0.3140.
      Terrier 4.1: 0.3163

      Should be: 0.3305
      Terrier 4.1: 0.3228

        Attachments

          Activity

          Hide
          richardm Richard McCreadie added a comment -

          We see a similar issue from the WT2G test suite
          java.lang.AssertionError: MAP was 0.3179 instead of 0.3181 expected:<0.3181000053882599> but was:<0.31790000200271606>

          Show
          richardm Richard McCreadie added a comment - We see a similar issue from the WT2G test suite java.lang.AssertionError: MAP was 0.3179 instead of 0.3181 expected:<0.3181000053882599> but was:<0.31790000200271606>
          Hide
          craigm Craig Macdonald added a comment -

          We replaced the quickstart values with a different test collection as part of the documentation rewrite. Will not fix.

          Show
          craigm Craig Macdonald added a comment - We replaced the quickstart values with a different test collection as part of the documentation rewrite. Will not fix.

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              smoran Sean Moran
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: