[jira] [Created] (FLINK-15160) Clean up is not applied if there are no incoming events for a key.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15160) Clean up is not applied if there are no incoming events for a key.

Shang Yuanchun (Jira)
Dawid Wysakowicz created FLINK-15160:
----------------------------------------

             Summary: Clean up is not applied if there are no incoming events for a key.
                 Key: FLINK-15160
                 URL: https://issues.apache.org/jira/browse/FLINK-15160
             Project: Flink
          Issue Type: Bug
          Components: Library / CEP
    Affects Versions: 1.9.1, 1.8.2, 1.10.0
            Reporter: Dawid Wysakowicz


In CepOperator the pruning of timed out partial matches happens along with feeding events into the NFA. Either when unbuffering on Watermark or according to the processing time.

1. Processing time
The state is pruned only with the timestamps of incoming events. If there are no incoming events no pruning happens

2. Event time
It is slightly more complicated, but the outcome is similar. We register timers that pop events from the buffer, but we do not register any timers for when the timeout of a partial match could happen. Therefore if there will be no more events we will never prune matches.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)