[jira] [Created] (FLINK-11818) Provide pipe transformation function for DataSet API

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11818) Provide pipe transformation function for DataSet API

Shang Yuanchun (Jira)
vinoyang created FLINK-11818:
--------------------------------

             Summary: Provide pipe transformation function for DataSet API
                 Key: FLINK-11818
                 URL: https://issues.apache.org/jira/browse/FLINK-11818
             Project: Flink
          Issue Type: Improvement
          Components: API / DataSet
            Reporter: vinoyang
            Assignee: vinoyang


We have some business requirements that require the data handled by Flink to interact with some external programs (such as Python/Perl/shell scripts). There is no such function in the existing DataSet API, although it can be implemented by the map function, but it is not concise. It would be helpful if we could provide a pipe[1] function like Spark.

[1]: https://spark.apache.org/docs/latest/rdd-programming-guide.html#transformations



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)