Till Rohrmann created FLINK-17503:
-------------------------------------
Summary: Make memory configuration logging more user-friendly
Key: FLINK-17503
URL:
https://issues.apache.org/jira/browse/FLINK-17503 Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Affects Versions: 1.10.0
Reporter: Till Rohrmann
Fix For: 1.11.0, 1.10.2
The newly introduced memory configuration logs some output:
{code}
2020-05-04 11:50:05,984 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.cpu.cores' , default: null (fallback keys: []) required for local execution is not set, setting it to its default value 1.7976931348623157E308
2020-05-04 11:50:05,989 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.memory.task.heap.size' , default: null (fallback keys: []) required for local execution is not set, setting it to its default value 9223372036854775807 bytes
2020-05-04 11:50:05,989 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.memory.task.off-heap.size' , default: 0 bytes (fallback keys: []) required for local execution is not set, setting it to its default value 9223372036854775807 bytes
2020-05-04 11:50:05,990 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.memory.network.min' , default: 64 mb (fallback keys: [{key=taskmanager.network.memory.min, isDeprecated=true}]) required for local execution is not set, setting it to its default value 64 mb
2020-05-04 11:50:05,990 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.memory.network.max' , default: 1 gb (fallback keys: [{key=taskmanager.network.memory.max, isDeprecated=true}]) required for local execution is not set, setting it to its default value 64 mb
2020-05-04 11:50:05,991 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option Key: 'taskmanager.memory.managed.size' , default: null (fallback keys: [{key=taskmanager.memory.size, isDeprecated=true}]) required for local execution is not set, setting it to its default value 128 mb
{code}
This logging output could be made more user-friendly the following way:
* Print only the key string of a {{ConfigOption}}, not the config option object with all the deprecated keys
* Skipping the lines for {{taskmanager.memory.task.heap.size}} and {{taskmanager.memory.task.off-heap.size}} - we don't really set them (they are JVM paramaters) and the printing of long max looks strange (user would have to know these are place holders without effect).
* Maybe similarly skipping the CPU cores value, this looks the strangest (double max).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
