[jira] [Created] (FLINK-11199) Support interactive programming in Flink

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11199) Support interactive programming in Flink

Shang Yuanchun (Jira)
Jiangjie Qin created FLINK-11199:
------------------------------------

             Summary: Support interactive programming in Flink
                 Key: FLINK-11199
                 URL: https://issues.apache.org/jira/browse/FLINK-11199
             Project: Flink
          Issue Type: New Feature
    Affects Versions: 2.0.0
            Reporter: Jiangjie Qin


Generally speaking, Flink applications may consist of one or more jobs, and the jobs may want to share the data with others. In Flink, the jobs in the same application are independent and share nothing among themselves. If a Flink application involves several sequential steps, each step (as an independent job) will have to write its intermediate results to an external sink, so that its results can be used by the following step (job) as sources. Although this works, that means users have to provide external storage and explicitly write/read from it. 

 

To improve the user experience, we would like to propose adding support of interactive programming in Flink. We would like to start with Table API. And the discussion thread is following:

https://docs.google.com/document/d/1d4T2zTyfe7hdncEUAxrlNOYr4e5IMNEZLyqSuuswkA0/edit?ts=5bf639d9#



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)