[jira] [Created] (FLINK-1139) HadoopOutputFormat fails for DOP > 1

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1139) HadoopOutputFormat fails for DOP > 1

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-1139:
------------------------------------

             Summary: HadoopOutputFormat fails for DOP > 1
                 Key: FLINK-1139
                 URL: https://issues.apache.org/jira/browse/FLINK-1139
             Project: Flink
          Issue Type: Bug
          Components: Hadoop Compatibility
            Reporter: Fabian Hueske


HadoopOutputFormat fails for DOP > 1. The reason is that job finalization (removal of the temp directory) is done after the first task finishes.
All other tasks will fail in that moment, since they cannot continue to write their data to the temp directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)