[jira] [Created] (FLINK-1236) Add support for localization of Hadoop Input Splits

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1236) Add support for localization of Hadoop Input Splits

Shang Yuanchun (Jira)
Robert Metzger created FLINK-1236:
-------------------------------------

             Summary: Add support for localization of Hadoop Input Splits
                 Key: FLINK-1236
                 URL: https://issues.apache.org/jira/browse/FLINK-1236
             Project: Flink
          Issue Type: Improvement
            Reporter: Robert Metzger
            Priority: Minor


Flink is currently not localizing splits created by Hadoop Input formats.

The getInputSplitAssigner() of the HadoopInputFormat is returning the DefaultInputSplitAssigner instead of the LocatableInputSplitAssigner().

It should be possible to make the HadoopInputSplit a LocatableInputSplit, because Hadoop's InputSplit also contains the hostnames, for exactly this purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)