[jira] [Created] (FLINK-1345) Add operator chaining to the streaming runtime

[Shang Yuanchun (Jira)]

Gyula Fora created FLINK-1345:
---------------------------------

             Summary: Add operator chaining to the streaming runtime
                 Key: FLINK-1345
                 URL: https://issues.apache.org/jira/browse/FLINK-1345
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Priority: Minor


Operator chaining should be added as a runtime optimisation to the streaming system as well.

A straightforward way to implement this is to add a new ChainableStreamInvokable class which also implements the collector interface. Operators like map, filter ... should extend this class.

After this the jobgraphbuilder should analyze the invokables to determine if chaining should be used: check if the invokable is a ChainableInvokable and all connections are forward with the same parallelism.

The chained invokables should then be passed as collectors to the previous ones as in the batch runtime.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)