[jira] [Created] (FLINK-1786) Add support for pipelined programs with slot count exceeding parallelism

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1786) Add support for pipelined programs with slot count exceeding parallelism

Shang Yuanchun (Jira)
Ufuk Celebi created FLINK-1786:
----------------------------------

             Summary: Add support for pipelined programs with slot count exceeding parallelism
                 Key: FLINK-1786
                 URL: https://issues.apache.org/jira/browse/FLINK-1786
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime, JobManager
    Affects Versions: master
            Reporter: Ufuk Celebi


We support slot count exceeding parallelism with blocking results and w/o slot sharing (FLINK-1709).

We need to add support for this with pipelined results as well (w/o slot sharing). The runtime needs support for mixed pipelined and blocking subpartitions and the job manager needs to be aware of how to deploy such mixed results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)