Problem with custom accumulators

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Problem with custom accumulators

Leonidas Fegaras
Hi,
There is a problem with custom accumulators in local and cluster modes.
When I run the EmptyFieldsCountAccumulator example:

cd flink-0.6-incubating
flink-dist/target/flink-0.6-incubating-bin/flink-0.6-incubating/bin/start-local.sh
flink-dist/target/flink-0.6-incubating-bin/flink-0.6-incubating/bin/flink run flink-examples/flink-java-examples/target/flink-java-examples-0.6-incubating.jar -c org.apache.flink.example.java.relational.EmptyFieldsCountAccumulator

the job manager finishes but the program doesn't terminate.
Is this a bug?
Leonidas
Reply | Threaded
Open this post in threaded view
|

Re: Problem with custom accumulators

Robert Metzger
Hi,
I was able to reproduce the issue and filed a bug report:
https://issues.apache.org/jira/browse/FLINK-1046

Thank you for reporting the issue!


Robert


On Tue, Aug 12, 2014 at 8:36 PM, Fegaras, Leonidas <[hidden email]>
wrote:

> Hi,
> There is a problem with custom accumulators in local and cluster modes.
> When I run the EmptyFieldsCountAccumulator example:
>
> cd flink-0.6-incubating
>
> flink-dist/target/flink-0.6-incubating-bin/flink-0.6-incubating/bin/start-local.sh
> flink-dist/target/flink-0.6-incubating-bin/flink-0.6-incubating/bin/flink
> run
> flink-examples/flink-java-examples/target/flink-java-examples-0.6-incubating.jar
> -c org.apache.flink.example.java.relational.EmptyFieldsCountAccumulator
>
> the job manager finishes but the program doesn't terminate.
> Is this a bug?
> Leonidas
>
Reply | Threaded
Open this post in threaded view
|

Re: Problem with custom accumulators

Stephan Ewen
Hi!

I think that is a problem with the classloaders, that the wrong one is used
on the client side. I am looking into this...

Stephan
Reply | Threaded
Open this post in threaded view
|

Re: Problem with custom accumulators

Stephan Ewen
Hey!

The latest master branch and the upcoming release have a fix for that.

Stephan