[jira] [Created] (FLINK-2281) Allow chaining of operators with multiple inputs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2281) Allow chaining of operators with multiple inputs

Shang Yuanchun (Jira)
Gyula Fora created FLINK-2281:
---------------------------------

             Summary: Allow chaining of operators with multiple inputs
                 Key: FLINK-2281
                 URL: https://issues.apache.org/jira/browse/FLINK-2281
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Assignee: Gyula Fora
            Priority: Minor


Currently only operators with one input can be chained for better performance. In principle there is no reason why this should not be extended to multiple input operators (where chaining is applicable, i.e forward connected), to allow maximal speedup.

The concern usually arises that it might not be good to always chain everything in case of computation heavy operators. In these cases (if the job is otherwise viable) chaining only increases latency for some operations while the throughput is increased exploiting by increasing the parallelism to the freed resources.

In any case chaining should still remain tunable on an operator level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)