[jira] [Created] (FLINK-21341) Update state reader to return InputFormat

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21341) Update state reader to return InputFormat

Shang Yuanchun (Jira)
Seth Wiesman created FLINK-21341:
------------------------------------

             Summary: Update state reader to return InputFormat
                 Key: FLINK-21341
                 URL: https://issues.apache.org/jira/browse/FLINK-21341
             Project: Flink
          Issue Type: Improvement
          Components: API / State Processor
    Affects Versions: 1.13.0
            Reporter: Seth Wiesman


The state processor api on read currently takes an ExecutionEnvironment and returns a DataSet. As Flink now supports Bounded DataStream we want to support that as well but not have to maintain parallel apis. To that end we propose the following.

Introduce a new `load` method to Savepoint.

 
{code:java}
SavepointReader Savepoint#load(String path, StateBackend backend);
{code}
SavepointReader will contain the same read methods as ExistingSavepoint but they will instead return InputFormat<T, ?>. This way the input format can be used with either DataSet, DataStream, or Table API.

 

The reader methods in ExistingSavepoint should be deprecated.

 

Additionally, OperatorStateInputFormat and KeyedStateInputFormat should both now extend ResultTypeQueryable so users get efficient serializer for their reads.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)