[jira] [Resolved] (FLINK-815) Improve partitioning hash function

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (FLINK-815) Improve partitioning hash function

Shang Yuanchun (Jira)

     [ https://issues.apache.org/jira/browse/FLINK-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Metzger resolved FLINK-815.
----------------------------------

       Resolution: Fixed
    Fix Version/s: pre-apache-0.5
                   0.6-incubating

This issue has been resolved in this commit: https://github.com/stratosphere/stratosphere/commit/39fd71ae04faa2761579afdf4f13f97340b34c34

> Improve partitioning hash function
> ----------------------------------
>
>                 Key: FLINK-815
>                 URL: https://issues.apache.org/jira/browse/FLINK-815
>             Project: Flink
>          Issue Type: Bug
>            Reporter: GitHub Import
>              Labels: github-import
>             Fix For: pre-apache, 0.6-incubating, pre-apache-0.5
>
>
> Right now, the partitioner (`OutputEmitter`) used directly the hash code produced by the partitioning elements. Types like `Integer` have very weak hash functions, so the hash partitioning is very susceptible to skew there.
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/815
> Created by: [StephanEwen|https://github.com/StephanEwen]
> Labels: runtime,
> Milestone: Release 0.6 (unplanned)
> Created at: Wed May 14 21:40:36 CEST 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.2#6252)