[jira] [Created] (FLINK-17998) Support limiting job history size

[Shang Yuanchun (Jira)]

Daniel Laszlo Magyar created FLINK-17998:
--------------------------------------------

             Summary: Support limiting job history size
                 Key: FLINK-17998
                 URL: https://issues.apache.org/jira/browse/FLINK-17998
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Configuration
            Reporter: Daniel Laszlo Magyar


Flink history server stores information for an unlimited number of completed jobs, which is inconvenient to dig through on long-running instances and might cause performance degradation in the long run.

Spark for example addresses this issue by limiting the number of jobs to keep by a [configuration parameter|https://spark.apache.org/docs/2.2.0/monitoring.html#spark-configuration-options] {{spark.history.retainedApplications}} with a default of 50 jobs to keep.

Introducing a similar configuration option to the Flink history server would improve the usability and performability of long-running history server instances.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)