[jira] [Created] (FLINK-13101) Introduce "blocking after chaining off" property of StreamGraph

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13101) Introduce "blocking after chaining off" property of StreamGraph

Shang Yuanchun (Jira)
Biao Liu created FLINK-13101:
--------------------------------

             Summary: Introduce "blocking after chaining off" property of StreamGraph
                 Key: FLINK-13101
                 URL: https://issues.apache.org/jira/browse/FLINK-13101
             Project: Flink
          Issue Type: Improvement
          Components: API / DataStream
            Reporter: Biao Liu
            Assignee: Biao Liu
             Fix For: 1.9.0


The property "blocking after chaining off" means, if there are some stream edges that can not be chained and the shuffle mode of edge is not specified, translate these edges into {{BLOCKING}} result partition type.

The reason of introducing it is to satisfy the requirement of Blink batch planner. Because the current scheduling strategy is a bit simple. It can not support some complex scenarios, like a batch job with resources limited.

To be honest, it's probably a work-around solution. However it's an internal implementation, we can replace it when we are able to support batch job by scheduling strategy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)