[TR-207] Adhoc Evaluation returns bad precision at percent Created: 24/Jul/12  Updated: 06/Mar/14  Resolved: 06/Mar/14

Status: Resolved
Project: Terrier Core
Component/s: .querying
Affects Version/s: 3.5
Fix Version/s: 3.6

Type: Bug Priority: Minor
Reporter: Sadi Samy Assignee: Craig Macdonald
Resolution: Fixed  
Labels: None

Attachments: File example.eval     File fix.diff    

 Description   
When I run trec_terrier.sh -e, I get a .eval file with precision at rank and precision at percent values.
The precision at percent values seems wrong. I get sometimes values bigger than 1, whereas these values should be between 0 and 1.

I've joined a fix for this. See attachment.

 Comments   
Comment by Craig Macdonald [ 25/Jul/12 ]

Hi Sadi,

Thanks for this. Do you have a concrete example that I could make into a unit test?

Comment by Craig Macdonald [ 25/Jul/12 ]

Tagging for 3.6

Comment by Sadi Samy [ 26/Jul/12 ]

No example for a unit test sorry. But here is typical example of a .eval file I get after running trecterrier.sh -e.

Comment by Richard McCreadie [ 06/Mar/14 ]

Patch seems reasonable, changes 'adjustOrPutValue' to 'put'. Committed patch to 3745.

Generated at Thu Dec 14 10:14:51 GMT 2017 using JIRA 7.1.1#71004-sha1:d6b2c0d9b7051e9fb5e4eb8ce177ca56d91d7bd8.