[jira] [Created] (FLINK-3946) State API Should Support Data Expiration

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3946) State API Should Support Data Expiration

Shang Yuanchun (Jira)
Elias Levy created FLINK-3946:
---------------------------------

             Summary: State API Should Support Data Expiration
                 Key: FLINK-3946
                 URL: https://issues.apache.org/jira/browse/FLINK-3946
             Project: Flink
          Issue Type: Improvement
          Components: state backends
    Affects Versions: 1.0.3
            Reporter: Elias Levy


The state API should support data expiration.  Consider a custom data stream operator that operates on a keyed stream and maintains a cache of items in its keyed state.  The operator can expire items in the state based on event time or  processing time.  But as the state is keyed, if the operator is never invoked again for a previously observed key, the state associated with that key will never be expired, leading the overall job state to grow indefinitely.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)