[jira] [Created] (FLINK-20972) TwoPhaseCommitSinkFunction Output a large amount of EventData

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20972) TwoPhaseCommitSinkFunction Output a large amount of EventData

Shang Yuanchun (Jira)
huajiewang created FLINK-20972:
----------------------------------

             Summary: TwoPhaseCommitSinkFunction Output a large amount of EventData
                 Key: FLINK-20972
                 URL: https://issues.apache.org/jira/browse/FLINK-20972
             Project: Flink
          Issue Type: Improvement
          Components: API / DataStream
    Affects Versions: 1.12.0
         Environment: flink 1.4.0 +
            Reporter: huajiewang


when TwoPhaseCommitSinkFunctionOutput tigger notifyCheckpointComplete,

Maybe A large number of EventData will be output (log.info)

,which will cause IO bottleneck and disk waste

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)