[jira] [Created] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-15311:
------------------------------------

             Summary: Lz4BlockCompressionFactory should use native compressor instead of java unsafe
                 Key: FLINK-15311
                 URL: https://issues.apache.org/jira/browse/FLINK-15311
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
            Reporter: Jingsong Lee
             Fix For: 1.10.0


According to:

[https://lz4.github.io/lz4-java/1.7.0/lz4-compression-benchmark/]

Java java unsafe compressor has lower performance than native lz4 compressor.

In testing, I found shuffle using java unsafe compressor.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)