Details
-
Type:
Improvement
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 3.0
-
Fix Version/s: 3.0
-
Component/s: .structures
-
Labels:None
Description
Recent core changes have made generic PostingIndex and PostingIndexInputStream objects which give access to IterablePostings. It would be good to have an InputFormat for splitting the reading of a PostingIndex across various map tasks.
This would have benefits in the following scenarios:
As a PostingIndex can be large, locality should be supported.