[jira] [Created] (FLINK-11192) rockdb customize configuration Covered jobmaster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11192) rockdb customize configuration Covered jobmaster

Shang Yuanchun (Jira)
Fan weiwen created FLINK-11192:
----------------------------------

             Summary: rockdb customize configuration Covered jobmaster
                 Key: FLINK-11192
                 URL: https://issues.apache.org/jira/browse/FLINK-11192
             Project: Flink
          Issue Type: Bug
          Components: State Backends, Checkpointing
    Affects Versions: 1.7.0, 1.6.2
            Reporter: Fan weiwen


set state backends is rocksdb 

set 'state.backend.rocksdb.timer-service.factory' by  Configuration not flink-conf.yaml

 
{code:java}

RocksDBStateBackend backend = new RocksDBStateBackend(checkpointPath,true);
Configuration configuration = new Configuration();
configuration.setString(
   RocksDBOptions.TIMER_SERVICE_FACTORY,
   RocksDBStateBackend.PriorityQueueStateType.ROCKSDB.toString());
backend = backend.configure(configuration);
{code}
 

 

then submit the job by client

but  the job runtime the 'TIMER_SERVICE_FACTORY'  Covered  by jobmaster
{code:java}
RocksDBOptions.TIMER_SERVICE_FACTORY{code}
jobmaster code

org.apache.flink.runtime.state.StateBackendLoader

 
{code:java}

backend = ((ConfigurableStateBackend) fromApplication).configure(config);
{code}
 

 

jobmaster  buildGraph  config is from flink-conf.yaml

Final execution of the same method

org.apache.flink.contrib.streaming.state.RocksDBStateBackend

 
{code:java}

final String priorityQueueTypeString = config.getString(TIMER_SERVICE_FACTORY);

this.priorityQueueStateType = priorityQueueTypeString.length() > 0 ?
   PriorityQueueStateType.valueOf(priorityQueueTypeString.toUpperCase()) : original.priorityQueueStateType;
{code}
 

 

the problem is   config.getString(TIMER_SERVICE_FACTORY)   

always have value regardless of configuration 

so my customize  config by Covered by jobmatser 

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)