[jira] [Created] (FLINK-20762) Remove unused checkpointStorage path after job finished

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20762) Remove unused checkpointStorage path after job finished

Shang Yuanchun (Jira)
Liu created FLINK-20762:
---------------------------

             Summary: Remove unused checkpointStorage path after job finished
                 Key: FLINK-20762
                 URL: https://issues.apache.org/jira/browse/FLINK-20762
             Project: Flink
          Issue Type: Improvement
            Reporter: Liu


    Current checkpoint structure is as following:
{code:java}
/user-defined-checkpoint-dir
    |
    + --shared/
    + --taskowned/
    + --chk-00001/
    + --chk-00002/...
{code}
    After cancelling job, the checkpointStorage will not be removed.  For some cases, the dictionary can not removed. For example, external checkpoint is retain or taskowned is used. 

    If all the sub-dictionaries are empty, maybe the checkpointStorage can be removed. Otherwise, there will be lots of unused dictionaries with time going on. I wonder whether this is a problem. If so, I would like to fix it. Thank you.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)