[jira] [Created] (FLINK-19801) Add support for virtual channels

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19801) Add support for virtual channels

Shang Yuanchun (Jira)
Arvid Heise created FLINK-19801:
-----------------------------------

             Summary: Add support for virtual channels
                 Key: FLINK-19801
                 URL: https://issues.apache.org/jira/browse/FLINK-19801
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Checkpointing
    Affects Versions: 1.12.0
            Reporter: Arvid Heise
            Assignee: Arvid Heise


During rescaling of unaligned checkpoints, if state from multiple former channels are read on input or output side to recover a specific channel, then these buffers are multiplexed on output side and demultiplexed on input side to guarantee a consistent recovery of spanning records.

Channels use the mapping of FLINK-19533 to infer the need for virtual channels and distribute the needed resources. Virtual channels are removed on the EndOfChannelRecovery epoch marker.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)