[jira] [Created] (FLINK-21222) Support loopback mode to allow Python UDF worker and client reuse the same Python VM

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21222) Support loopback mode to allow Python UDF worker and client reuse the same Python VM

Shang Yuanchun (Jira)
Dian Fu created FLINK-21222:
-------------------------------

             Summary: Support loopback mode to allow Python UDF worker and client reuse the same Python VM
                 Key: FLINK-21222
                 URL: https://issues.apache.org/jira/browse/FLINK-21222
             Project: Flink
          Issue Type: Improvement
          Components: API / Python
            Reporter: Dian Fu


Currently the Python process for the client and the Python UDF worker runs in different Python processes. It would bring the following benefits if we could support loopback mode to allow Python UDF worker and client reuse the same Python VM:
1) It could greatly reduce the job initialization overhead in mini-cluster mode as there is no need to start the Python process any more.
2) It makes the debug easier.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)