Yingjie Cao created FLINK-14180:
-----------------------------------
Summary: Enable config of maximum capacity of FileArchivedExecutionGraphStore.
Key: FLINK-14180
URL:
https://issues.apache.org/jira/browse/FLINK-14180 Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Reporter: Yingjie Cao
Fix For: 1.10.0
Currently, Flink session cluster uses FileArchivedExecutionGraphStore to keep finished jobs for historic requests. The FileArchivedExecutionGraphStore purges archived ExecutionGraphs only by an expiration time. In a session cluster on which runs many batch jobs, it is hard to config the jobstore.expiration-time, if configured too short, the historical information may have been deleted when the user want to check it, and if configured too long, the web front end may response very slowly when the number of finished job is too large. We'd better add a new config option to allow config of the maximum capacity of the FileArchivedExecutionGraphStore, which is well supported by Guava Cache. Then we can set the expiration time to a relative long value and set the maximum capacity to an appropriate value which does not make the web ui become too slow.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
