[jira] [Created] (FLINK-4971) Unify Stream Sinks and OutputFormats

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-4971) Unify Stream Sinks and OutputFormats

Shang Yuanchun (Jira)
Stephan Ewen created FLINK-4971:
-----------------------------------

             Summary: Unify Stream Sinks and OutputFormats
                 Key: FLINK-4971
                 URL: https://issues.apache.org/jira/browse/FLINK-4971
             Project: Flink
          Issue Type: Sub-task
            Reporter: Stephan Ewen
             Fix For: 2.0.0


Right now, many output connectors exist in two variants: OutputFormat and StreamSink.

Wrapping an output format to a stream sink is not quite possible, because output formats cannot be cleanly integrated into checkpointing. For example, they have no hook to ensure that data is written/persisted at the time of a checkpoint.

We should try and see if we can make both one, or at least make the OutputFormats such that they can be wrapped into a stream sink and behave well with respect to checkpointing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)