[jira] [Created] (FLINK-9138) Enhance BucketingSink to also flush data by time interval

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-9138) Enhance BucketingSink to also flush data by time interval

Shang Yuanchun (Jira)
Narayanan Arunachalam created FLINK-9138:
--------------------------------------------

             Summary: Enhance BucketingSink to also flush data by time interval
                 Key: FLINK-9138
                 URL: https://issues.apache.org/jira/browse/FLINK-9138
             Project: Flink
          Issue Type: Improvement
          Components: filesystem-connector
    Affects Versions: 1.4.2
            Reporter: Narayanan Arunachalam


BucketingSink now supports flushing data to the file system by size limit and by period of inactivity. It will be useful to also flush data by a specified time period. This way, the data will be written out when write throughput is low but there is no significant time period gaps between the writes. This reduces ETA for the data in the file system and should help move the checkpoints faster as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)