[jira] [Created] (FLINK-13803) Introduce SpillableHeapKeyedStateBackend and all necessities

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13803) Introduce SpillableHeapKeyedStateBackend and all necessities

Shang Yuanchun (Jira)
Yu Li created FLINK-13803:
-----------------------------

             Summary: Introduce SpillableHeapKeyedStateBackend and all necessities
                 Key: FLINK-13803
                 URL: https://issues.apache.org/jira/browse/FLINK-13803
             Project: Flink
          Issue Type: Sub-task
            Reporter: Yu Li


This JIRA aims at introducing a new {{SpillableHeapKeyedStateBackend}} which will reuse most code of the {{HeapKeyedStateBackend}} (probably the only difference is the spill-able one will register a {{HybridStateTable}}), and allow using it in {{FsStateBackend}} and {{MemoryStateBackend}} (only as an option, by default still {{HeapKeyedStateBackend}}) through configuration.

The related necessities include but are not limited to:
* A relative backend builder class
* Relative restore operation classes
* Necessary configurations for using spill-able backend

This should be the last JIRA after which the spill-able heap backend feature will become runnable regardless of the stability and performance.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)