[jira] [Created] (FLINK-21777) Replace the 4M data writing cache of sort-merge shuffle with writev system call

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21777) Replace the 4M data writing cache of sort-merge shuffle with writev system call

Shang Yuanchun (Jira)
Yingjie Cao created FLINK-21777:
-----------------------------------

             Summary: Replace the 4M data writing cache of sort-merge shuffle with writev system call
                 Key: FLINK-21777
                 URL: https://issues.apache.org/jira/browse/FLINK-21777
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
    Affects Versions: 1.12.0
            Reporter: Yingjie Cao
             Fix For: 1.13.0


Currently, the sort-merge shuffle implementation uses 4M unmanned direct memory as cache for data written. It can be replaced by the writev system call which can reduce the unmanned direct memory usage without any performance loss.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)