Class NamedPageEvaluation

  • All Implemented Interfaces:
    Evaluation

    public class NamedPageEvaluation
    extends TerrierEvaluation
    Performs the evaluation for TREC's named/home page finding task. The evaluation measure is the average reciprocal rank of those relevant documents that are among the top 50 documents.
    Author:
    Vassilis Plachouras
    • Field Summary

      Fields 
      Modifier and Type Field Description
      protected double arr
      The average reciprocal rank.
      protected int inTop1
      The number of queries where the answer is found in the top first rank.
      protected int inTop10
      The number of queries where the answer is found in the top 10 docs.
      protected int inTop20
      The number of queries for which the answer is found in the top 20 docs.
      protected int inTop5
      The number of queries where the answer is found in the top 5 docs.
      protected int inTop50
      The number of queries where the answer is found in the top 50 docs.
      protected int notInTop50
      The number of queries where the answer was not found in the top 50 documents.
      protected int numberOfQueries
      total number of queries.
      protected gnu.trove.TIntHashSet queryNumbers
      The query numbers' vector.
      protected gnu.trove.TIntIntHashMap rankRelevantDocument
      the rank of the correct answer for each query evaluated.
      protected gnu.trove.TIntDoubleHashMap recipRank
      The reciprocal rank of each query.
    • Field Detail

      • arr

        protected double arr
        The average reciprocal rank.
      • numberOfQueries

        protected int numberOfQueries
        total number of queries.
      • rankRelevantDocument

        protected gnu.trove.TIntIntHashMap rankRelevantDocument
        the rank of the correct answer for each query evaluated.
      • inTop50

        protected int inTop50
        The number of queries where the answer is found in the top 50 docs.
      • inTop20

        protected int inTop20
        The number of queries for which the answer is found in the top 20 docs.
      • inTop10

        protected int inTop10
        The number of queries where the answer is found in the top 10 docs.
      • inTop5

        protected int inTop5
        The number of queries where the answer is found in the top 5 docs.
      • inTop1

        protected int inTop1
        The number of queries where the answer is found in the top first rank.
      • notInTop50

        protected int notInTop50
        The number of queries where the answer was not found in the top 50 documents.
      • queryNumbers

        protected gnu.trove.TIntHashSet queryNumbers
        The query numbers' vector.
      • recipRank

        protected gnu.trove.TIntDoubleHashMap recipRank
        The reciprocal rank of each query.
    • Constructor Detail

      • NamedPageEvaluation

        public NamedPageEvaluation()
    • Method Detail

      • evaluate

        public void evaluate​(java.lang.String resultFilename)
        Evaluates the given result file.
        Specified by:
        evaluate in interface Evaluation
        Specified by:
        evaluate in class TerrierEvaluation
        Parameters:
        resultFilename - String the filename of the result file to evaluate.