[jira] [Created] (FLINK-18175) Add human readable summary for configured and derived memory sizes.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18175) Add human readable summary for configured and derived memory sizes.

Shang Yuanchun (Jira)
Xintong Song created FLINK-18175:
------------------------------------

             Summary: Add human readable summary for configured and derived memory sizes.
                 Key: FLINK-18175
                 URL: https://issues.apache.org/jira/browse/FLINK-18175
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.10.1, 1.11.0
            Reporter: Xintong Song


FLIP-49 & FLIP-116 introduces sophisticated memory configurations for TaskManager and Master processes. Before the JVM processes are started, Flink derives the accurate sizes for all necessary components, based on both explicit user configurations and implicit defaults.

To make the configuration results (especially those implicitly derived) clear to users, it would be helpful to print them in the beginning of the process logs. Currently, we only have printed JVM parameters (TM & Master) dynamic memory configurations (TM only). They are incomplete (jvm overhead for both processes and off-heap memory for the master process are not presented) and unfriendly (in bytes).

Therefore, I propose to add a human readable summary at the beginning of process logs.

See also this [PR discussion|https://github.com/apache/flink/pull/11445#discussion_r435721169].



--
This message was sent by Atlassian Jira
(v8.3.4#803005)