[jira] [Created] (FLINK-19508) Add collect() operation on DataStream

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19508) Add collect() operation on DataStream

Shang Yuanchun (Jira)
Aljoscha Krettek created FLINK-19508:
----------------------------------------

             Summary: Add collect() operation on DataStream
                 Key: FLINK-19508
                 URL: https://issues.apache.org/jira/browse/FLINK-19508
             Project: Flink
          Issue Type: Improvement
          Components: API / DataStream
            Reporter: Aljoscha Krettek


With the recent changes/additions to {{DataStreamUtils.collect()}} that make it more robust by using the regular REST client to fetch results from operators it might make sense to add a {{collect()}} operation right on {{DataStream}}.

This operation is still not meant for big data volumes but I think it can be useful for debugging and fetching small amounts of messages to the client. When we do this, we can also think about changing {{print()}} to print on the client instead of to the {{TaskManager}} stdout. I think the current behaviour of this operation is mostly confusing for users.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)