|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.terrier.evaluation.Evaluation org.terrier.evaluation.NamedPageEvaluation
public class NamedPageEvaluation
Performs the evaluation for TREC's named/home page finding task. The evaluation measure is the average reciprocal rank of those relevant documents that are among the top 50 documents.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.terrier.evaluation.Evaluation |
---|
Evaluation.Record |
Field Summary | |
---|---|
protected double |
arr
The average reciprocal rank. |
protected int |
inTop1
The number of queries where the answer is found in the top first rank. |
protected int |
inTop10
The number of queries where the answer is found in the top 10 docs. |
protected int |
inTop20
The number of queries for which the answer is found in the top 20 docs. |
protected int |
inTop5
The number of queries where the answer is found in the top 5 docs. |
protected int |
inTop50
The number of queries where the answer is found in the top 50 docs. |
protected int |
notInTop50
The number of queries where the answer was not found in the top 50 documents. |
protected int |
numberOfQueries
total number of queries. |
protected gnu.trove.TIntHashSet |
queryNumbers
The query numbers' vector. |
protected gnu.trove.TIntIntHashMap |
rankRelevantDocument
the rank of the correct answer for each query evaluated. |
protected gnu.trove.TIntDoubleHashMap |
recipRank
The reciprocal rank of each query. |
Fields inherited from class org.terrier.evaluation.Evaluation |
---|
logger, qrels |
Constructor Summary | |
---|---|
NamedPageEvaluation()
|
Method Summary | |
---|---|
void |
evaluate(java.lang.String resultFilename)
Evaluates the given result file. |
void |
writeEvaluationResult(java.io.PrintWriter out)
Output the evaluation result to the specific file. |
void |
writeEvaluationResultOfEachQuery(java.lang.String resultEvalFilename)
Output the evaluation result of each query to the specific file. |
Methods inherited from class org.terrier.evaluation.Evaluation |
---|
writeEvaluationResult, writeEvaluationResult |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected double arr
protected int numberOfQueries
protected gnu.trove.TIntIntHashMap rankRelevantDocument
protected int inTop50
protected int inTop20
protected int inTop10
protected int inTop5
protected int inTop1
protected int notInTop50
protected gnu.trove.TIntHashSet queryNumbers
protected gnu.trove.TIntDoubleHashMap recipRank
Constructor Detail |
---|
public NamedPageEvaluation()
Method Detail |
---|
public void evaluate(java.lang.String resultFilename)
evaluate
in class Evaluation
resultFilename
- String the filename
of the result file to evaluate.public void writeEvaluationResultOfEachQuery(java.lang.String resultEvalFilename)
writeEvaluationResultOfEachQuery
in class Evaluation
resultEvalFilename
- String the name of the file in which to
save the evaluation results.public void writeEvaluationResult(java.io.PrintWriter out)
writeEvaluationResult
in class Evaluation
out
- PrintWriter the name of the stream to output the result.
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |