Hi devs,
I would like to start the discussion about supporting multiple input for
blink planner.
As FLIP-92[1] introduces multiple-input stream operator, we can merge the
operators connected by forward shuffle into multiple input operator. So
that the network shuffle can be changed to local function calls,
and significantly performance improvement can be achieved when there is
plenty of data to shuffle.
We have written a design document[2] to describe the details. Please feel
free to join the discussion and any feedback is welcome!
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-92%3A+Add+N-Ary+Stream+Operator+in+Flink[2]
https://docs.google.com/document/d/1qKVohV12qn-bM51cBZ8Hcgp31ntwClxjoiNBUOqVHsIBest,
Godfrey & Caizhi
Locked
