[TR-59] Reset problem in Terrier evaluation tool Created: 10/Sep/09 Updated: 05/Mar/10 Resolved: 16/Sep/09
|Reporter:||Iadh Ounis||Assignee:||Craig Macdonald|
Nicola reported today a bug with the Terrier evaluation tool. For some queries, the system reports an MAP of 2 (yes 2) at precision @1. It appears that it is a resetting problem when multiple evaluation files are used.
|Comment by Craig Macdonald [ 16/Sep/09 ]|
Not a reset problem actually. A problem calculating precision at rank.
because ranks are 0 based.
I have also added test cases for the AdhocEvaluation class. The test cases check various measures (hand calculated) for rankings upto size 4. Without the patch, the test fails. With it, the test passes.
|Comment by Iadh Ounis [ 16/Sep/09 ]|
Well spotted Craig!