[jira] [Created] (FLINK-20213) Partition commit is delayed when records keep coming

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20213) Partition commit is delayed when records keep coming

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-20213:
------------------------------------

             Summary: Partition commit is delayed when records keep coming
                 Key: FLINK-20213
                 URL: https://issues.apache.org/jira/browse/FLINK-20213
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem
    Affects Versions: 1.11.2
            Reporter: Jingsong Lee
            Assignee: Jingsong Lee
             Fix For: 1.12.0


When set partition-commit.delay=0, Users expect partitions to be committed immediately.

However, if the record of this partition continues to flow in, the bucket for the partition will be activated, and no inactive bucket will appear.

We need to consider listening to bucket created.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)