[jira] [Created] (FLINK-1959) Accumulators BROKEN after Partitioning

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1959) Accumulators BROKEN after Partitioning

Shang Yuanchun (Jira)
mustafa elbehery created FLINK-1959:
---------------------------------------

             Summary: Accumulators BROKEN after Partitioning
                 Key: FLINK-1959
                 URL: https://issues.apache.org/jira/browse/FLINK-1959
             Project: Flink
          Issue Type: Bug
          Components: Examples
    Affects Versions: 0.8.1
            Reporter: mustafa elbehery
            Priority: Critical
             Fix For: 0.8.1


while running the Accumulator example in https://github.com/Elbehery/flink/blob/master/flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/relational/EmptyFieldsCountAccumulator.java,

I tried to alter the data flow with "PartitionByHash" function before applying "Filter", and the resulted accumulator was NULL.

By Debugging, I could see the accumulator in the RunTime Map. However, by retrieving the accumulator from the JobExecutionResult object, it was NULL.


The line caused the problem is "file.partitionByHash(1).filter(new EmptyFieldFilter())" instead of "file.filter(new EmptyFieldFilter())"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)