[jira] [Created] (FLINK-12172) Flink fails to close pending BucketingSink

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12172) Flink fails to close pending BucketingSink

Shang Yuanchun (Jira)
 Mario Georgiev created FLINK-12172:
---------------------------------------

             Summary: Flink fails to close pending BucketingSink
                 Key: FLINK-12172
                 URL: https://issues.apache.org/jira/browse/FLINK-12172
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.7.2
            Reporter:  Mario Georgiev


Hello,

The problem is if you have a BucketingSink, the following case may occur :

Let's say you have a 2019-04-12–12 bucket created with several files inside which are pending/finished
You create a savepoint and shut down the job
After an hour for instance you start the job from the savepoint and a new bucket is created, 2019-04-16 for instance. 
The problem is that the .pending ones from the old buckets seem to never be moved to finished state. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)