[jira] [Created] (FLINK-4430) prevent BLOCKING partition data lose when task is finished

[Shang Yuanchun (Jira)]

Kurt Young created FLINK-4430:
---------------------------------

             Summary: prevent BLOCKING partition data lose when task is finished
                 Key: FLINK-4430
                 URL: https://issues.apache.org/jira/browse/FLINK-4430
             Project: Flink
          Issue Type: Sub-task
            Reporter: Kurt Young


When we have a BLOCKING result partition type, the data is actually holded by TaskManager, not the slot. When we finish the produce task, we will mark this task finished and try to release the slot. Under the new architecture, with yarn or mesos mode, releasing slot may trigger releasing the container, so the TaskManager will be terminated, thus the result data is lost. We should introduce some mechanism to prevent this from happening.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)