[jira] [Created] (FLINK-1237) Add custom partitioners for shuffle steps

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1237) Add custom partitioners for shuffle steps

Shang Yuanchun (Jira)
Till Rohrmann created FLINK-1237:
------------------------------------

             Summary: Add custom partitioners for shuffle steps
                 Key: FLINK-1237
                 URL: https://issues.apache.org/jira/browse/FLINK-1237
             Project: Flink
          Issue Type: Improvement
            Reporter: Till Rohrmann
            Assignee: Stephan Ewen


It would be helpful to be able to specify a custom partitioner for shuffle steps. This would users allow to control how their data is distributed across the cluster. Especially in situations where the number of data records is equal to the number of slots it might be a possibility to avoid skewed data distributions due to the default hashing function.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)