[jira] [Created] (FLINK-18523) The watermark could be updated without data for some time

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18523) The watermark could be updated without data for some time

Shang Yuanchun (Jira)
chen yong created FLINK-18523:
---------------------------------

             Summary: The watermark could be updated without data for some time
                 Key: FLINK-18523
                 URL: https://issues.apache.org/jira/browse/FLINK-18523
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.11.0
            Reporter: chen yong


In the case of window calculations and eventTime scenarios, watermar cannot update because the source does not have data for some reason, and the last Windows cannot trigger the calculations.

One parameter, table.exec.source. Idle -timeout, can only solve the problem of ignoring parallelism of watermark alignment that does not occur.But when there is no watermark in each parallel degree, you still cannot update the watermark.

Is it possible to add a lock-timeout parameter (which should be larger than maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated beyond this time (i.e., there is no data), then the current time is taken and sent downstream as the watermark.

 

thanks!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)