[jira] [Created] (FLINK-17337) Send UPDATE messages instead of INSERT and DELETE in streaming join operator

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17337) Send UPDATE messages instead of INSERT and DELETE in streaming join operator

Shang Yuanchun (Jira)
Jark Wu created FLINK-17337:
-------------------------------

             Summary: Send UPDATE messages instead of INSERT and DELETE in streaming join operator
                 Key: FLINK-17337
                 URL: https://issues.apache.org/jira/browse/FLINK-17337
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / Runtime
            Reporter: Jark Wu


Currently, streaming join operator always send INSERT and DELETE messages for simplification if it's not inner join. However, we can send UPDATE_BEFORE and UPDATE_AFTER messages instead of INSERT and DELETE. For example, when we recieve right record "b", then we can send {{UB[a, null]}} and {{UA[a,b]}} instead of {{D[a,null]}}, {{I[a,b]}}. This is an optimization, because UB can be omitted in some cases to reduce IO cost and computation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)