Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-34

Property values for single-pass indexing are not scaled

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.1
    • Fix Version/s: None
    • Component/s: .indexing, .utility
    • Labels:
      None

      Description

      The value of property "memory.reserved" is interpreted as bytes, and not in MB as stated in the sample property file.
      The value of "memory.heap.usage" is interpreted as real number, and not as percentage.

      When using the default settings (memory.reserved=50, memory.heap.usage=85), the condition in RuntimeMemoryChecker therefore never gets true and the intermediate runs are not written to disk. When indexing large datasets, this leads to out of memory exceptions.

      Maybe it would be a good idea to check the valid range of these properties and output a warning.

        Attachments

          Issue Links

            Activity

            Hide
            craigm Craig Macdonald added a comment -

            Thanks for the heads up about the sample properties file. I have added suitable checks to the relevant Terrier class for checking that these properties are properly set in the future.

            Show
            craigm Craig Macdonald added a comment - Thanks for the heads up about the sample properties file. I have added suitable checks to the relevant Terrier class for checking that these properties are properly set in the future.
            Hide
            craigm Craig Macdonald added a comment -

            Committed to trunk. Thanks!

            Show
            craigm Craig Macdonald added a comment - Committed to trunk. Thanks!

              People

              • Assignee:
                craigm Craig Macdonald
                Reporter:
                philipps Philipp Sorg
              • Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: