[jira] [Created] (FLINK-14877) Enable FRocksDB to optimize performance via options when bounding total memory

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14877) Enable FRocksDB to optimize performance via options when bounding total memory

Shang Yuanchun (Jira)
Yun Tang created FLINK-14877:
--------------------------------

             Summary: Enable FRocksDB to optimize performance via options when bounding total memory
                 Key: FLINK-14877
                 URL: https://issues.apache.org/jira/browse/FLINK-14877
             Project: Flink
          Issue Type: Sub-task
            Reporter: Yun Tang
             Fix For: 1.10.0


Currently, as we plan to keep base on RocksDB-5.17.2 and cherry-pick write-buffer manager related rocksJava commits to FRocksDB. Options below are recommend when bounding the total memory.
{code:java}
tableConfig.setCacheIndexAndFilterBlocksWithHighPriority(true);
tableConfig.setPinTopLevelIndexAndFilter(true);
{code}

However, RocksDB-5.17.2 does not include these java API. But luckily, these features are already implemented on RocksDB's native code. Cherry pick https://github.com/facebook/rocksdb/pull/4589 with only updates on java side should be enough.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)