[jira] [Created] (FLINK-18097) History server doesn't clean all job json files

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18097) History server doesn't clean all job json files

Shang Yuanchun (Jira)
Milan Nikl created FLINK-18097:
----------------------------------

             Summary: History server doesn't clean all job json files
                 Key: FLINK-18097
                 URL: https://issues.apache.org/jira/browse/FLINK-18097
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Web Frontend
    Affects Versions: 1.10.1
            Reporter: Milan Nikl


Improvement introduced in https://issues.apache.org/jira/browse/FLINK-14169 does not delete all files in the history server folders completely.

There is a [json file created for each job|https://github.com/apache/flink/blob/master/flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/history/HistoryServerArchiveFetcher.java#L237-L238] in history server's {{webDir/jobs/}} directory. Such file is not deleted by {{cleanupExpiredJobs}}.

And while the cleaned up job is no longer visible in History server's {{Completed Jobs List}} in web UI, it can be still accessed on {{<HistoryServerURL>/#/job/<jobId>/overview}}.

While this bug probably won't lead to any serious issues, files in history server's folders should be cleaned up thoroughly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)