[jira] [Created] (FLINK-8784) Share network buffer pool among different partition operators

[Shang Yuanchun (Jira)]

Garrett Li created FLINK-8784:
---------------------------------

             Summary: Share network buffer pool among different partition operators
                 Key: FLINK-8784
                 URL: https://issues.apache.org/jira/browse/FLINK-8784
             Project: Flink
          Issue Type: Improvement
          Components: TaskManager
            Reporter: Garrett Li


A logical network connection exists for each point-to-point exchange of data over the network, which typically happens at repartitioning- or broadcasting steps (shuffle phase). et

Sometimes we have a lot of repartitioning and broadcasting in the Flink job, and currently Flink divide the network buffer pool evenly for every partition operators, sometimes it could waste too many network buffers since NOT all of the partition operators in the same job have the same traffic.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)