[jira] [Created] (FLINK-19485) Consider runtime-mode when creating the StreamGraph

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19485) Consider runtime-mode when creating the StreamGraph

Shang Yuanchun (Jira)
Kostas Kloudas created FLINK-19485:
--------------------------------------

             Summary: Consider runtime-mode when creating the StreamGraph
                 Key: FLINK-19485
                 URL: https://issues.apache.org/jira/browse/FLINK-19485
             Project: Flink
          Issue Type: Sub-task
          Components: API / DataStream
    Affects Versions: 1.12.0
            Reporter: Kostas Kloudas
            Assignee: Kostas Kloudas


Although DataStream is going to be the unified API for Batch and Streaming applications, some operations, e.g. Sinks, may need to have different runtime implementations depending on if they are intended to run on bounded or unbounded data. This is not necessarily only for optimisations but also for the exposed semantics, i.e. correctness.

So far, DataStream had a 1-to-1 mapping between an API call and an operator. In a sense, the DataStream API was an "explicit" API. With this addition, we will decouple the API calls from the actual runtime implementations and thus allow different operations to have more than one runtime implementations, depending (for now) on the {{execution.runtime-mode}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)