uk.ac.gla.terrier.evaluation
Class Evaluation

java.lang.Object
  uk.ac.gla.terrier.evaluation.Evaluation

Direct Known Subclasses:

AdhocEvaluation, NamedPageEvaluation

public abstract class Evaluation
extends java.lang.Object

An abstract class for evaluating the retrieval results.

Version:

$Revision: 1.23 $

Author:

Gianni Amati, Ben He, Vassilis Plachouras

Nested Class Summary

class

Evaluation.Record A structure of a record of retrieved document.

Field Summary

TRECQrelsInMemory

qrels A structure of all the records in the qrels files.

Constructor Summary

Evaluation()

Method Summary

abstract void	evaluate(java.lang.String resultFilename) Evaluates the given result file for the given qrels file.
void	writeEvaluationResult() Output the evaluation result to standard output
abstract void	writeEvaluationResult(java.io.PrintStream out) The abstract method that evaluates and prints the results.
void	writeEvaluationResult(java.lang.String evaluationResultFilename) Output the evaluation result to the specific file.
abstract void	writeEvaluationResultOfEachQuery(java.lang.String evaluationResultFilename) Output the evaluation result of each query to the specific file.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

qrels

public TRECQrelsInMemory qrels

A structure of all the records in the qrels files.

Constructor Detail

Evaluation

public Evaluation()

Method Detail

evaluate

public abstract void evaluate(java.lang.String resultFilename)

Evaluates the given result file for the given qrels file. All subclasses must implement this method.

Parameters:

resultFilename - java.lang.String the filename of the result file to evaluate.

writeEvaluationResult

public void writeEvaluationResult()

Output the evaluation result to standard output

writeEvaluationResult

public abstract void writeEvaluationResult(java.io.PrintStream out)

The abstract method that evaluates and prints the results. All the subclasses of Evaluation must implement this method.

Parameters:

out - java.io.PrintStream

writeEvaluationResultOfEachQuery

public abstract void writeEvaluationResultOfEachQuery(java.lang.String evaluationResultFilename)

Output the evaluation result of each query to the specific file.

Parameters:

evaluationResultFilename - String the name of the file in which to save the evaluation results.

writeEvaluationResult

public void writeEvaluationResult(java.lang.String evaluationResultFilename)

Output the evaluation result to the specific file.

Parameters:

evaluationResultFilename - java.lang.String the filename of the file to output the result.