[jira] [Created] (FLINK-2706) Add support for streaming RollingFileSink to truncate / append on UNIX file systems

[Shang Yuanchun (Jira)]

Stephan Ewen created FLINK-2706:
-----------------------------------

             Summary: Add support for streaming RollingFileSink to truncate / append on UNIX file systems
                 Key: FLINK-2706
                 URL: https://issues.apache.org/jira/browse/FLINK-2706
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
    Affects Versions: 0.10
            Reporter: Stephan Ewen


Efficient exactly-once behavior needs the filesystem to support appending and truncating files.

Since the UNIX file system API allows to append files and truncate files, we can support perfect exactly-once behavior efficiently on all file systems that expose a UNIX / POSIX-style interface (local FS, NFS, MapR FS).

Without this support, only Hadoop 2.7+ versions support proper exactly once behavior.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)