[jira] [Created] (FLINK-10912) Configurable RocksDBStateBackend options factory

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-10912) Configurable RocksDBStateBackend options factory

Shang Yuanchun (Jira)
Thomas Weise created FLINK-10912:
------------------------------------

             Summary: Configurable RocksDBStateBackend options factory
                 Key: FLINK-10912
                 URL: https://issues.apache.org/jira/browse/FLINK-10912
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.7.0
            Reporter: Thomas Weise


RocksDB has a ton of configuration options and users should be able to reach those, when necessary. Currently there are a few predefined configurations that can be activated programmatically [1] [2]. This requires change to the pipeline construction code that's hard or impossible when using higher level API or frameworks such as Apache Beam. It would be good to support an options factory that can be specified as part of the state backend configuration in flink-conf.yaml.

[1] https://github.com/apache/flink/blob/release-1.5/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/PredefinedOptions.java#L44

[2] https://stackoverflow.com/questions/44819521/how-to-set-rocksdbstatebackend-parameter-in-flink



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)