[jira] [Created] (FLINK-11313) [checkpoint] Introduce LZ4 compression for keyed state in full checkpoints and savepoints

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11313) [checkpoint] Introduce LZ4 compression for keyed state in full checkpoints and savepoints

Shang Yuanchun (Jira)
Yun Tang created FLINK-11313:
--------------------------------

             Summary: [checkpoint] Introduce LZ4 compression for keyed state in full checkpoints and savepoints
                 Key: FLINK-11313
                 URL: https://issues.apache.org/jira/browse/FLINK-11313
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
            Reporter: Yun Tang
            Assignee: Yun Tang
             Fix For: 1.8.0


In our production environment, we prefer to use LZ4 instead of Snappy as compression for better performance, which is also [recommended by RocksDB |https://github.com/facebook/rocksdb/wiki/Compression#configuration].

I plan to introduce LZ4 except for now existing snappy compression for keyed state in full checkpoint and savepoints.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)