Details
-
Type:
Bug
-
Status: Resolved
-
Priority:
Trivial
-
Resolution: Fixed
-
Affects Version/s: 3.5
-
Fix Version/s: 3.6
-
Component/s: .evaluation
-
Labels:None
Description
TRECQrelsInMemory.loadQrelsFile() method accepts wrong documents in
qrels file as relevant such that
"boolean relevant = !(relGrade == 0);".
It should be "boolean relevant = (relGrade > 0);", because in the
current Web track qrels, "junk" documents are marked as minus 2 (-2),
which is also different from 0.
[identified by B. Taner DINCER]
Attachments
Activity
Field | Original Value | New Value |
---|---|---|
Status | Open [ 1 ] | Resolved [ 5 ] |
Resolution | Fixed [ 1 ] |
Committed, with unit test, r3666. Thanks taner.