[jira] [Created] (FLINK-15962) Reduce the default chunk size in netty stack

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15962) Reduce the default chunk size in netty stack

Shang Yuanchun (Jira)
zhijiang created FLINK-15962:
--------------------------------

             Summary: Reduce the default chunk size in netty stack
                 Key: FLINK-15962
                 URL: https://issues.apache.org/jira/browse/FLINK-15962
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Network
            Reporter: zhijiang


The current default chunk size inside netty stack is 16MB, and one arena would create multiple chunks based on demands. But it does not mean that the new chunk is created after the previous one was fully exhausted, which would further boost the direct memory overhead.

In order to decrease the total memory overhead caused by netty, we can reduce the default chunk size and measure the effect via existing e2e, and also verify the performance concern via the benchmarks.

This improvement is orthogonal to the [FLINK-10742|https://issues.apache.org/jira/browse/FLINK-10742



--
This message was sent by Atlassian Jira
(v8.3.4#803005)