[jira] [Created] (FLINK-11282) Merge StreamRecordWriter into RecordWriter

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11282) Merge StreamRecordWriter into RecordWriter

Shang Yuanchun (Jira)
zhijiang created FLINK-11282:
--------------------------------

             Summary: Merge StreamRecordWriter into RecordWriter
                 Key: FLINK-11282
                 URL: https://issues.apache.org/jira/browse/FLINK-11282
             Project: Flink
          Issue Type: Sub-task
          Components: Network
            Reporter: zhijiang
            Assignee: zhijiang
             Fix For: 1.8.0


{{StreamRecordWriter}} is only used for streaming job which extends {{RecordWriter}}. The only difference in {{StreamRecordWriter}} is maintaining the {{OutputFlusher}} thread which can be migrated into {{RecordWriter}} because the {{flushAlways}} property in {{RecordWriter}} has relationship with {{OutputFlusher}}.

To do so, we can introduce the special {{BroadcastRecordWriter}} which extends {{RecordWriter}} for improving broadcast selector for [FLINK-10662|https://issues.apache.org/jira/browse/FLINK-10662] . And the {{RecordWriter}} division is unified for both streaming and batch jobs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)