[jira] [Created] (FLINK-4902) Flink Task Chain not getting input in a distributed manner

[Shang Yuanchun (Jira)]

Sajeev Ramakrishnan created FLINK-4902:
------------------------------------------

             Summary: Flink Task Chain not getting input in a distributed manner
                 Key: FLINK-4902
                 URL: https://issues.apache.org/jira/browse/FLINK-4902
             Project: Flink
          Issue Type: Bug
          Components: DataSet API
    Affects Versions: 1.1.0
         Environment: RHEL 6.6
            Reporter: Sajeev Ramakrishnan


Dear Team,

  I have the following tasks chained as a single subtask.

left outer join -> filter -> map -> flatMap.

The input to this would be two streams
memberPlan - 22 million
groupPlan - 1 million.

I am running the entire job with parallelism 16. Before this task chain, I am doing two left outer joins.

The problem is that one slot is getting 22 million and rest 15 slots are getting the input from groupPlan.

This is making the entire execution very slow, probably 4 hours slower.

Can you please throw some light on this.

Regards,
Sajeev




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)