Fwd: [stratosphere-users] Printing/Outputting inside Iterations

Posted by Robert Metzger on Jun 18, 2014; 11:32am
URL: http://deprecated-apache-flink-mailing-list-archive.368.s1.nabble.com/Fwd-stratosphere-users-Printing-Outputting-inside-Iterations-tp395.html

Forwarding the question to the new list as well ...

---------- Forwarded message ----------
From: Fabian Hueske <[hidden email]>
Date: Wed, Jun 18, 2014 at 11:21 AM
Subject: Re: [stratosphere-users] Printing/Outputting inside Iterations
To: "[hidden email]" <
[hidden email]>


Hi Asterios,

this mailing list is no longer used.
All mails (user + dev) should go to the [hidden email]
mailing list.

Would you post your question to the other list?

Thanks, Fabian


2014-06-18 11:14 GMT+02:00 Asterios Katsifodimos <[hidden email]>:

Hi,

>
> is there a way to output/print an intermediate result from within a delta
> iteration? The compiler complains about this:
>
>  DeltaIteration<Tuple2<Long, Long>, Tuple2<Long, Long>> iteration =
> verticesWithCID.iterateDelta(verticesWithCID, 10, 0);
> DataSet<Tuple2<Long,Long>> delta = iteration.getWorkset().join(edges).
> where(0).equalTo(1).with(new VertexComponentIDProjector<Long>()).groupBy(0
> ).
> aggregate(Aggregations.MIN, 1)
> .join(iteration.getSolutionSet()).where(0).equalTo(0).with(new
> VertexComponentIDProjectorWithFilter());
> //delta.writeAsCsv("delta.txt", "\n", " ");
>
> delta.print();
> iteration.closeWith(delta, delta).print();
>
>
> With (btw the error is not intuitive at all):
>
> Exception in thread "main" java.lang.RuntimeException: Error while
> creating the data flow plan for the program: Unknown operator or data set
> type: eu.stratosphere.api.java.DeltaIteration$WorksetPlaceHolder@48f0c0d3
>  at
> eu.stratosphere.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:97)
>
> ...
>
>
> Cheers,
> Asterios
>
> --
> You received this message because you are subscribed to the Google Groups
> "stratosphere-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [hidden email].
> Visit this group at http://groups.google.com/group/stratosphere-users.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/stratosphere-users/05c3111b-4f12-427d-b9fc-82a77a3b20ad%40googlegroups.com
> <https://groups.google.com/d/msgid/stratosphere-users/05c3111b-4f12-427d-b9fc-82a77a3b20ad%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

 --
You received this message because you are subscribed to the Google Groups
"stratosphere-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to [hidden email].
Visit this group at http://groups.google.com/group/stratosphere-users.
To view this discussion on the web visit
https://groups.google.com/d/msgid/stratosphere-users/CAAdrtT3y2AZ_CmJUw%3Dvo8KSjgjnyqGT8q1XYrb437hLrcBYARA%40mail.gmail.com
<https://groups.google.com/d/msgid/stratosphere-users/CAAdrtT3y2AZ_CmJUw%3Dvo8KSjgjnyqGT8q1XYrb437hLrcBYARA%40mail.gmail.com?utm_medium=email&utm_source=footer>
.

For more options, visit https://groups.google.com/d/optout.