[jira] [Created] (FLINK-14107) Kinesis consumer record emitter may deadlock under event time alignment

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14107) Kinesis consumer record emitter may deadlock under event time alignment

Shang Yuanchun (Jira)
Thomas Weise created FLINK-14107:
------------------------------------

             Summary: Kinesis consumer record emitter may deadlock under event time alignment
                 Key: FLINK-14107
                 URL: https://issues.apache.org/jira/browse/FLINK-14107
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kinesis
    Affects Versions: 1.9.0, 1.8.2
            Reporter: Thomas Weise
            Assignee: Thomas Weise


When the emitter reaches the max timestamp for the current queue, it stops emitting and waits for the max timestamp to advance. Since it simultaneously selects the next queue as the new "minimum" queue, it may deadlock if the previous min queue represents the new global lower bound after the max timestamp advanced. This occurs very infrequently and we were finally able to reproduce.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)