[jira] [Created] (FLINK-17564) Inflight data of incoming channel may be disordered for unaligned checkpoint

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17564) Inflight data of incoming channel may be disordered for unaligned checkpoint

Shang Yuanchun (Jira)
Yingjie Cao created FLINK-17564:
-----------------------------------

             Summary: Inflight data of incoming channel may be disordered for unaligned checkpoint
                 Key: FLINK-17564
                 URL: https://issues.apache.org/jira/browse/FLINK-17564
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.11.0
            Reporter: Yingjie Cao
             Fix For: 1.11.0


For unaligned checkpoint, when checkpointing the inflight data of incoming channel, both task thread and Netty thread may add data to the channel state writer. More specifically, the task thread will first request inflight buffers from the input channel and add the buffers to the channel state writer, and then the Netty thread will add the following up buffers (if any) to the channel state writer. The buffer adding of task thread and Netty thread is not synchronized so the Netty thread may add buffers before the task thread which leads to disorder of the data andĀ corruption of the data stream.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)