[jira] [Created] (FLINK-4777) ContinuousFileMonitoringFunction may throw IOException when files are moved

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-4777) ContinuousFileMonitoringFunction may throw IOException when files are moved

Shang Yuanchun (Jira)
Maximilian Michels created FLINK-4777:
-----------------------------------------

             Summary: ContinuousFileMonitoringFunction may throw IOException when files are moved
                 Key: FLINK-4777
                 URL: https://issues.apache.org/jira/browse/FLINK-4777
             Project: Flink
          Issue Type: Bug
          Components: Streaming Connectors
    Affects Versions: 1.1.2, 1.2.0
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
            Priority: Critical
             Fix For: 1.2.0, 1.1.3


FileSystem.listStatus(path) may throw an IOException when it lists files and then retrieves their file status. This is quite common, e.g. editors which create temporary files and move them. The ContinuousFileMonitoringFunction can only apply a filter filter afterwards. Thus, this problem can't easily be avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)