[jira] [Created] (FLINK-1215) FileSystem.initOutPathLocalFS can lead to race condition

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1215) FileSystem.initOutPathLocalFS can lead to race condition

Shang Yuanchun (Jira)
Aljoscha Krettek created FLINK-1215:
---------------------------------------

             Summary: FileSystem.initOutPathLocalFS can lead to race condition
                 Key: FLINK-1215
                 URL: https://issues.apache.org/jira/browse/FLINK-1215
             Project: Flink
          Issue Type: Bug
          Components: Local Runtime
            Reporter: Aljoscha Krettek
            Priority: Minor
             Fix For: 0.8-incubating


This can fail when concurrent tasks notice about deleting/creating the output directory.

Seen in a travis log:

Failed tests:
  LocalExecutorITCase.testLocalExecutorWithWordCount:61 java.io.IOException: Output directory 'file:/tmp/wctext7874076083387578604.out' could not be created. Canceling task...
        at org.apache.flink.api.common.io.FileOutputFormat.open(FileOutputFormat.java:232)
        at org.apache.flink.api.java.record.io.CsvOutputFormat.open(CsvOutputFormat.java:261)
        at org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:172)
        at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:245)
        at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)