Fan weiwen created FLINK-11192:
----------------------------------
Summary: rockdb customize configuration Covered jobmaster
Key: FLINK-11192
URL:
https://issues.apache.org/jira/browse/FLINK-11192 Project: Flink
Issue Type: Bug
Components: State Backends, Checkpointing
Affects Versions: 1.7.0, 1.6.2
Reporter: Fan weiwen
set state backends is rocksdb
set 'state.backend.rocksdb.timer-service.factory' by Configuration not flink-conf.yaml
{code:java}
RocksDBStateBackend backend = new RocksDBStateBackend(checkpointPath,true);
Configuration configuration = new Configuration();
configuration.setString(
RocksDBOptions.TIMER_SERVICE_FACTORY,
RocksDBStateBackend.PriorityQueueStateType.ROCKSDB.toString());
backend = backend.configure(configuration);
{code}
then submit the job by client
but the job runtime the 'TIMER_SERVICE_FACTORY' Covered by jobmaster
{code:java}
RocksDBOptions.TIMER_SERVICE_FACTORY{code}
jobmaster code
org.apache.flink.runtime.state.StateBackendLoader
{code:java}
backend = ((ConfigurableStateBackend) fromApplication).configure(config);
{code}
jobmaster buildGraph config is from flink-conf.yaml
Final execution of the same method
org.apache.flink.contrib.streaming.state.RocksDBStateBackend
{code:java}
final String priorityQueueTypeString = config.getString(TIMER_SERVICE_FACTORY);
this.priorityQueueStateType = priorityQueueTypeString.length() > 0 ?
PriorityQueueStateType.valueOf(priorityQueueTypeString.toUpperCase()) : original.priorityQueueStateType;
{code}
the problem is config.getString(TIMER_SERVICE_FACTORY)
always have value regardless of configuration
so my customize config by Covered by jobmatser
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)