[jira] [Created] (FLINK-13241) YarnResourceManager gives no response to second round slot allocations

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13241) YarnResourceManager gives no response to second round slot allocations

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-13241:
-------------------------------

             Summary: YarnResourceManager gives no response to second round slot allocations
                 Key: FLINK-13241
                 URL: https://issues.apache.org/jira/browse/FLINK-13241
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
    Affects Versions: 1.9.0
            Reporter: Zhu Zhu
         Attachments: 17_37_05__07_12_2019.jpg

In the case that a job allocates a few slots first and after a period allocates some other slots. The YarnResourceManager seems to receive and ignore the latter slot requests.

To produce this issue, we can create a job with 2 vertices in different shared groups, as shown below:

!17_37_05__07_12_2019.jpg|width=433,height=127!

map2 vertex needs to wait until the source vertex to decide its location, thus to meet the input constraints.

YarnResourceManager can receive slot requests for map2, but seems not to handle it and the job will hang there waiting for resources.

In my observation, this issue does not happen on Flink(Version: 1.9-SNAPSHOT, Rev:3bc322a, Date:26.06.2019 @ 17:28:51 CST). It should be a new issue after that.

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)