[jira] [Created] (FLINK-2924) Create database state backend

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2924) Create database state backend

Shang Yuanchun (Jira)
Gyula Fora created FLINK-2924:
---------------------------------

             Summary: Create database state backend
                 Key: FLINK-2924
                 URL: https://issues.apache.org/jira/browse/FLINK-2924
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Assignee: Gyula Fora


The goal is to create a database state backend that can be used with JDBC supporting databases.

The backend should support the storage of non-partitioned states, and also the storage of Key-value states with high throughput. As databases provide advanced querying functionality the key-value state can be implemented to be lazily fetched and should scale to "arbitrary" state sizes by not storing the non-active key-values on heap.

An adapter class will be provided that can help bridge the gap between different sql implementations.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)