[jira] [Created] (FLINK-3300) Concurrency Bug in Yarn JobManager

[Shang Yuanchun (Jira)]

Stephan Ewen created FLINK-3300:
-----------------------------------

             Summary: Concurrency Bug in Yarn JobManager
                 Key: FLINK-3300
                 URL: https://issues.apache.org/jira/browse/FLINK-3300
             Project: Flink
          Issue Type: Bug
          Components: JobManager
    Affects Versions: 1.0.0
            Reporter: Stephan Ewen
            Priority: Blocker
             Fix For: 1.0.0


The change to use the async ResourceManager client introduced concurrency problems: The ResourceManager callback threads run and change data structures at the same time as the actor methods, voiding the actor concurrency model.

One example that can happen is that the callback tries to start containers while the ContainerLaunchContext is still not set (because the actor method is still in the StartYarnSession method).

Bug introducing commit: https://github.com/apache/flink/commit/4e52fe4304566e5239996b3d48290e0c1f0772e8

Quick fix could be to revert the commit. Better solution would be to let the callback methods send actor messages to the YobManager, rather than directly acting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)