[jira] [Created] (FLINK-3133) Introduce collect()/coun()/print() methods in DataStream API

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3133) Introduce collect()/coun()/print() methods in DataStream API

Shang Yuanchun (Jira)
Maximilian Michels created FLINK-3133:
-----------------------------------------

             Summary: Introduce collect()/coun()/print() methods in DataStream API
                 Key: FLINK-3133
                 URL: https://issues.apache.org/jira/browse/FLINK-3133
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API, Streaming
    Affects Versions: 0.10.1, 0.10.0, 1.0.0
            Reporter: Maximilian Michels
             Fix For: 1.0.0


The DataSet API's methods {{collect()}}, {{count()}}, and {{print()}} should be mirrored to the DataStream API.

The semantics of the calls are different. We need to be able to sample parts of a stream, e.g. by supplying a time period in the arguments to the methods. Collect/count/print should be lazily evaluated. Users should use the {{StreamEnvironment}} to retrieve the results.

{code:java}
StreamExecutionEnvironment env = StramEnvironment.getStreamExecutionEnvironment();

DataStream<Integer> printSink = env.addSource(..).print();

ResultQueryable queryObject = env.executeWithResultQueryable();

List<Integer> sampled = queryObject.retrieve(printSink, Time.seconds(5));
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)