[jira] [Created] (FLINK-3232) Add option to eagerly deploy channels

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3232) Add option to eagerly deploy channels

Shang Yuanchun (Jira)
Ufuk Celebi created FLINK-3232:
----------------------------------

             Summary: Add option to eagerly deploy channels
                 Key: FLINK-3232
                 URL: https://issues.apache.org/jira/browse/FLINK-3232
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
    Affects Versions: 0.10.1
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi
            Priority: Minor
             Fix For: 1.0.0


Intermediate partitions are consumed via input channels. These channels are instantiated lazily when the partition producer emits the first record. This can lead to higher latencies for the first records passing the pipeline.

In order to decrease this latency, we can deploy channels eagerly.

I would like to add this as a flag to the intermediate results of the execution graph. On deployment, the task can then deploy the input channels as soon as the intermediate stream has been registered at the partition manager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)