[jira] [Created] (FLINK-15897) Deserialize the Python UDF execution results when sending them out

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15897) Deserialize the Python UDF execution results when sending them out

Shang Yuanchun (Jira)
Dian Fu created FLINK-15897:
-------------------------------

             Summary: Deserialize the Python UDF execution results when sending them out
                 Key: FLINK-15897
                 URL: https://issues.apache.org/jira/browse/FLINK-15897
             Project: Flink
          Issue Type: Improvement
          Components: API / Python
            Reporter: Dian Fu
            Assignee: Dian Fu
             Fix For: 1.11.0


Currently, the Python UDF execution results are deserialized and then buffered in a collection when received from the Python worker. The deserialization could be deferred when sending the execution results to the downstream operator. That's to say, it buffers the serialized bytes instead of the deserialized Java objects in the buffer. This could reduce the memory footprint of the Java operator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)