[jira] [Created] (FLINK-1279) Change default partitioning setting for low parallelism stream sources from forward to distribute

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1279) Change default partitioning setting for low parallelism stream sources from forward to distribute

Shang Yuanchun (Jira)
Gyula Fora created FLINK-1279:
---------------------------------

             Summary: Change default partitioning setting for low parallelism stream sources from forward to distribute
                 Key: FLINK-1279
                 URL: https://issues.apache.org/jira/browse/FLINK-1279
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora


The default partitioning setting for all operators including stream sources are forward at the moment.

In many cases sources have lower parallelism therefore the forward connection might cause that only a subset of the operators will receive data.

Partitioning from source to the first operators should be changed to distribute data to all parallel instances of the first operators, when the source parallelism is lower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)