[jira] [Created] (FLINK-14566) Enable ResourceSpec to get/set whether managed memory is used

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14566) Enable ResourceSpec to get/set whether managed memory is used

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-14566:
-------------------------------

             Summary: Enable ResourceSpec to get/set whether managed memory is used
                 Key: FLINK-14566
                 URL: https://issues.apache.org/jira/browse/FLINK-14566
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.10.0
            Reporter: Zhu Zhu
             Fix For: 1.10.0


To calculate managed memory fraction for an operator with UNKNOWN resources, we need to know whether the operator will use managed memory, according to FLINK-14062.

I'd propose to define special values of onHeapManagedMemory/offHeapManagedMemory
in ResourceSpec(introduced in FLINK-14405) to distinguish whether managed memory is used.
- onHeapManagedMemory==MemorySize.ZERO means on heap managed memory is used, while onHeapManagedMemory==null means not.
- similar for off heap managed memory.

getters: isUsingManagedMemoryOnHeap()/isUsingManagedMemoryOffHeap()
setters: setUsingManagedMemoryOnHeap(boolean)/setUsingManagedMemoryOffHeap(boolean)
(setters are only allowed to invoke on UNKNOWN)

{{ResourceSpec#isKnown()}} should be added to replace existing UNKNOWN usages for equality checking.

cc [~ykt836] [~trohrmann] [~wuzang] [~azagrebin]




--
This message was sent by Atlassian Jira
(v8.3.4#803005)