[jira] [Created] (FLINK-20671) Partition doesn't commit until the end of partition

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20671) Partition doesn't commit until the end of partition

Shang Yuanchun (Jira)
zhuxiaoshang created FLINK-20671:
------------------------------------

             Summary: Partition doesn't commit until the end of partition
                 Key: FLINK-20671
                 URL: https://issues.apache.org/jira/browse/FLINK-20671
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem
    Affects Versions: 1.11.1, 1.12.0
            Reporter: zhuxiaoshang


According to DOC [https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/filesystem.html#partition-commit]

the partition can be commited multiple times.
Actually, the partition is commited until the end of partition.For example hourly partition, the 10th partition will be commited at 11 clock, even the `sink.partition-commit.delay` is 0s.

In theory,if delay is 0s the partition should be commited on every checkpoint.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)