[jira] [Created] (FLINK-11299) Decide the result partition type dynamically

[Shang Yuanchun (Jira)]

shuai.xu created FLINK-11299:
--------------------------------

             Summary: Decide the result partition type dynamically
                 Key: FLINK-11299
                 URL: https://issues.apache.org/jira/browse/FLINK-11299
             Project: Flink
          Issue Type: Improvement
          Components: JobManager
            Reporter: shuai.xu


Now, the result partition type is decided when compiling JobGraph at the client. This's to say, whether to output the result of a task to its consumers by PIPELINED or BLOCKING is decided at client and can not be changed any more. However, it is usually seen in batch jobs that a task is configured PIPELINED but its consumers can not be started due to lack of resource, this will lead to failover now. So we proposal to support deciding the result partition type dynamically during runtime according to the resource of cluster and so on to increase the success rate of batch job.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)