Nico Kruber created FLINK-18242:
-----------------------------------
Summary: Custom OptionsFactory in user code not working when configured via code
Key: FLINK-18242
URL:
https://issues.apache.org/jira/browse/FLINK-18242 Project: Flink
Issue Type: Bug
Components: Runtime / State Backends
Affects Versions: 1.10.1, 1.10.0
Reporter: Nico Kruber
Attachments: DefaultConfigurableOptionsFactoryWithLog.java
When I configure a custom {{OptionsFactory}} for RocksDB like this:
{code:java}
Configuration globalConfig = GlobalConfiguration.loadConfiguration();
String checkpointDataUri = globalConfig.getString(CheckpointingOptions.CHECKPOINTS_DIRECTORY);
RocksDBStateBackend stateBackend = new RocksDBStateBackend(checkpointDataUri);
stateBackend.setOptions(new DefaultConfigurableOptionsFactoryWithLog());
env.setStateBackend((StateBackend) stateBackend);{code}
it seems to be loaded
{code:java}
2020-06-10 12:54:20,720 INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend - Using predefined options: DEFAULT.
2020-06-10 12:54:20,721 INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend - Using application-defined options factory: DefaultConfigurableOptionsFactoryWithLog{DefaultConfigurableOptionsFactory{configuredOptions={}}}. {code}
but it seems like none of the options defined in there is actually used. Just as an example, my factory does set the info log level to {{INFO_LEVEL}} but this is what you will see in the created RocksDB instance:
{code:java}
> cat /tmp/flink-io-c95e8f48-0daa-4fb9-a9a7-0e4fb42e9135/*/db/OPTIONS*|grep info_log_level
info_log_level=HEADER_LEVEL
info_log_level=HEADER_LEVEL{code}
Together with the bug from FLINK-18241, is seems I cannot re-activate the RocksDB log that we disabled in FLINK-15068. FLINK-15747 was aiming at changing that particular configuration, but the problem seems broader since {{setDbLogDir()}} was actually also ignored.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
