Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-75

Terrier should allow us to set the runtag in our runs

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 3.0
    • Fix Version/s: 3.0
    • Component/s: .applications
    • Labels:
      None

      Description

      By being able to assign a tag for our produced runs within Terrier, we can better organise experimentation with different techniques, as well as avoid having to set the tag for actual TREC submission runs manually.

        Attachments

          Activity

          Hide
          rodrygo Rodrygo L. T. Santos added a comment -

          Committed to SVN. Run tags can be set with the trec.runtag property.

          Show
          rodrygo Rodrygo L. T. Santos added a comment - Committed to SVN. Run tags can be set with the trec.runtag property.
          Hide
          ounis Iadh Ounis added a comment -

          Was this not an existing feature? i.e. automatically recording the configuration file used, and its associated runtag?
          I guess that you still have to choose manually the runtag? How would you do it automatically?

          Show
          ounis Iadh Ounis added a comment - Was this not an existing feature? i.e. automatically recording the configuration file used, and its associated runtag? I guess that you still have to choose manually the runtag? How would you do it automatically?
          Hide
          rodrygo Rodrygo L. T. Santos added a comment -

          The automatic runtag assignment is still available, and is actually the default mechanism. The only new thing is the possibility to manually assign an arbitrary tag. It can be useful, for example, when summarising the results of lots of experiments directly into a latex table, in which case you could give your runs the caption that will appear in the tables, instead of having to create an additional mapping between the system generated tag and the one you want to display.

          Show
          rodrygo Rodrygo L. T. Santos added a comment - The automatic runtag assignment is still available, and is actually the default mechanism. The only new thing is the possibility to manually assign an arbitrary tag. It can be useful, for example, when summarising the results of lots of experiments directly into a latex table, in which case you could give your runs the caption that will appear in the tables, instead of having to create an additional mapping between the system generated tag and the one you want to display.
          Hide
          ounis Iadh Ounis added a comment -

          Ok. Good. Can someone test so as to commit to system.

          Show
          ounis Iadh Ounis added a comment - Ok. Good. Can someone test so as to commit to system.

            People

            • Assignee:
              rodrygo Rodrygo L. T. Santos
              Reporter:
              rodrygo Rodrygo L. T. Santos
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: