Terrier Users :  Terrier Forum terrier.org
General discussion about using/developing applications using Terrier 
not validating properly while evaluating
Posted by: bharathi ()
Date: June 29, 2017 08:44AM

My result file is like following

1 Q0 124030 75 15.855092811763223 PL2F
1 Q0 38037 76 15.851559555640353 PL2F
..
4 Q0 71252 829 4.730404792668452 PL2F
4 Q0 249892 830 4.730323517977681 PL2F
4 Q0 227597 831 4.727866345024646 PL2F
...
50 Q0 190292 997 12.207896597609768 PL2F
50 Q0 188307 998 12.204961968747988 PL2F
50 Q0 222864 999 12.203331928825758 PL2F


My topic file

<topics>
1 Swine flu vaccine
2 Rare cosmic events
....

49 International economic slump
50 Sachin Tendulkar's record of runs in Test Cricket
</topics>


My qrels file sample as follows

1 Q0 en.3.407.323.2007.11.24 0
1 Q0 en.3.414.4.2007.12.29 0
2 Q0 en.13.31.1.2009.12 1
2 Q0 en.13.31.19.2009.12 1
2 Q0 en.15.106.374.2009.1.25 0
2 Q0 en.15.132.109.2009.7.1 0

.....
4 Q0 en.3.348.6.2010.2.9 1
4 Q0 en.3.353.412.2010.3.13 0
4 Q0 en.3.355.151.2010.3.24 1
5 Q0 en.13.41.322.2010.2.28 1
5 Q0 en.15.203.470.2007.8.21 0
5 Q0 en.15.218.191.2007.11.3 1
6 Q0 en.3.380.497.2007.7.20 0
6 Q0 en.13.1.251.2009.6.2
7 Q0 en.13.30.348.2009.12.24 0
7 Q0 en.13.30.433.2009.12.23 0

.....


while evaluating i got the following as a result

____________________________________
Number of queries = 50
Retrieved = 50000
Relevant = 2760
Relevant retrieved = 0
____________________________________
Average Precision: 0.0000
R Precision : 0.0000
____________________________________
Precision at 1 : 0.0000
Precision at 2 : 0.0000
Precision at 3 : 0.0000
Precision at 4 : 0.0000
Precision at 5 : 0.0000
Precision at 10 : 0.0000
Precision at 15 : 0.0000
Precision at 20 : 0.0000
Precision at 30 : 0.0000
Precision at 50 : 0.0000
Precision at 100 : 0.0000
Precision at 200 : 0.0000
Precision at 500 : 0.0000
Precision at 1000 : 0.0000
____________________________________
Precision at 0%: 0.0000
Precision at 10%: 0.0000
Precision at 20%: 0.0000
Precision at 30%: 0.0000
Precision at 40%: 0.0000
Precision at 50%: 0.0000
Precision at 60%: 0.0000
Precision at 70%: 0.0000
Precision at 80%: 0.0000
Precision at 90%: 0.0000
Precision at 100%: 0.0000
____________________________________
Average Precision: 0.0000



i am using windows and my relevance file i converted into txt.
may that would have been wrong.i dont know how to resolve.
plz help me out.

thanks in advance

Options: ReplyQuote


Sorry, only registered users may post in this forum.
This forum powered by Phorum.