[jira] [Created] (FLINK-3296) DataStream.write*() methods are not flushing properly

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3296) DataStream.write*() methods are not flushing properly

Shang Yuanchun (Jira)
Robert Metzger created FLINK-3296:
-------------------------------------

             Summary: DataStream.write*() methods are not flushing properly
                 Key: FLINK-3296
                 URL: https://issues.apache.org/jira/browse/FLINK-3296
             Project: Flink
          Issue Type: Bug
          Components: Streaming Connectors
            Reporter: Robert Metzger
            Assignee: Robert Metzger
            Priority: Critical


The DataStream.write() methods rely on the {{FileSinkFunctionByMillis}} class, which has a logic for flushing records, even though the underlying stream is never flushed. This is misleading for users as files are not written as they would expect it.

The code was initial written with FileOutputFormats in mind, but the types were not set correctly. This PR opened the write() method to any output format: https://github.com/apache/flink/pull/706/files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)