[jira] [Created] (FLINK-17051) Persist spilled records of SpillingAdaptiveSpanningRecordDeserializer

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17051) Persist spilled records of SpillingAdaptiveSpanningRecordDeserializer

Shang Yuanchun (Jira)
Piotr Nowojski created FLINK-17051:
--------------------------------------

             Summary: Persist spilled records of SpillingAdaptiveSpanningRecordDeserializer
                 Key: FLINK-17051
                 URL: https://issues.apache.org/jira/browse/FLINK-17051
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Checkpointing, Runtime / Network
            Reporter: Piotr Nowojski
             Fix For: 1.11.0


Currently SpillingAdaptiveSpanningRecordDeserializer#copyToTargetSegment (which is used for unaligned checkpoints) throws UnsupportedOperationException for spilled records.

{code}
// for the case of full length, partial data in buffer
if (recordLength > THRESHOLD_FOR_SPILLING) {
        throw new UnsupportedOperationException("Unaligned checkpoint currently do not support spilled " +
                "records.");
}
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)