Stephan Ewen created FLINK-1214:
-----------------------------------
Summary: Prevent partitioning pushdown unless partitions fields match exactly
Key: FLINK-1214
URL:
https://issues.apache.org/jira/browse/FLINK-1214 Project: Flink
Issue Type: Bug
Components: Optimizer
Affects Versions: 0.8-incubating
Reporter: Stephan Ewen
Assignee: Stephan Ewen
Fix For: 0.8-incubating
Consider an operation grouped on fields (A, B), followed by an operation grouped on field (A).
Right now, the optimizer can push down the partitioning on (A), which serves both operations (the first step locally still groups by A and B). This may however by a bad idea for the cases where the field A has a low cardinality, or the value distribution is skewed.
Since we cannot determine that robustly yet, I suggest to disable this optimization for now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Locked
