[jira] [Created] (FLINK-19852) Managed memory released check can block IterativeTask

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19852) Managed memory released check can block IterativeTask

Shang Yuanchun (Jira)
shaomeng.wang created FLINK-19852:
-------------------------------------

             Summary: Managed memory released check can block IterativeTask
                 Key: FLINK-19852
                 URL: https://issues.apache.org/jira/browse/FLINK-19852
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Task
    Affects Versions: 1.11.2, 1.11.1, 1.10.2, 1.11.0
            Reporter: shaomeng.wang
         Attachments: image-2020-10-28-17-48-28-395.png, image-2020-10-28-17-48-48-583.png

UnsafeMemoryBudget#reserveMemory, called on TempBarrier, needs time to wait on GC of all allocated/released managed memory at every iteration.

 

stack:

!image-2020-10-28-17-48-48-583.png!

new TempBarrier in BatchTask

!image-2020-10-28-17-48-28-395.png!

 

These will be very slow than before.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)