[jira] [Created] (FLINK-11398) Add a dedicated phase to materialize time indicators for nodes produce updates

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11398) Add a dedicated phase to materialize time indicators for nodes produce updates

Shang Yuanchun (Jira)
Hequn Cheng created FLINK-11398:
-----------------------------------

             Summary: Add a dedicated phase to materialize time indicators for nodes produce updates
                 Key: FLINK-11398
                 URL: https://issues.apache.org/jira/browse/FLINK-11398
             Project: Flink
          Issue Type: Improvement
          Components: Table API & SQL
            Reporter: Hequn Cheng
            Assignee: Hequn Cheng


As discussed [here|https://github.com/apache/flink/pull/6787#discussion_r249056249], we need a dedicated phase to materialize time indicators for nodes produce updates.

Details:
Currently, we materialize time indicators in `RelTimeInidicatorConverter`. We need to introduce another materialize phase that materializes all time attributes on nodes that produce updates. We can not do it inside `RelTimeInidicatorConverter`, because only later, after physical optimization phase, we know whether it is a non-window outer join which will produce updates

There are a few other things we need to consider.
- Whether we can unify the two converter phase.
- Take window with early fire into consideration(not been implemented yet). In this case, we don't need to materialize time indicators even it produces updates.











--
This message was sent by Atlassian JIRA
(v7.6.3#76005)