Uploaded image for project: 'Terrier Core'
  1. Terrier Core
  2. TR-88

MultiFileSplit.java from Hadoop 0.18 is in Terrier core

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0
    • Component/s: .structures
    • Labels:
      None

      Description

      I dont know why this file has become part of the core. It is not owned by UoG.

        Attachments

          Activity

          Hide
          craigm Craig Macdonald added a comment -

          Resolved. Instead of directly copying the class, I have overridden it and provided a default constructor. A test case is also provided.

          Show
          craigm Craig Macdonald added a comment - Resolved. Instead of directly copying the class, I have overridden it and provided a default constructor. A test case is also provided.
          Hide
          craigm Craig Macdonald added a comment -

          The problem was that PositionAwareSplit has to serialize its inner split. This is complicated by the fact that MultiFileSplit's default constuctor is not visible to PositionAwareSplit.

          Show
          craigm Craig Macdonald added a comment - The problem was that PositionAwareSplit has to serialize its inner split. This is complicated by the fact that MultiFileSplit's default constuctor is not visible to PositionAwareSplit.

            People

            • Assignee:
              craigm Craig Macdonald
              Reporter:
              craigm Craig Macdonald
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: