[jira] [Created] (FLINK-19046) Introduce separate classes for PipelinedResultPartition and BoundedBlockingResultPartition

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19046) Introduce separate classes for PipelinedResultPartition and BoundedBlockingResultPartition

Shang Yuanchun (Jira)
Stephan Ewen created FLINK-19046:
------------------------------------

             Summary: Introduce separate classes for PipelinedResultPartition and BoundedBlockingResultPartition
                 Key: FLINK-19046
                 URL: https://issues.apache.org/jira/browse/FLINK-19046
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.12.0


Currently, the SubPartition classes are specific to the partition type (pipelined, batched/blocking) but the parent Partition class is shared.

Given that the partitions behave differently regarding checkpoints, releasing, etc. the code is cleaner separated by introducing dedicated classes for the {{ResultPartitions}} based on the type.

This is also an important preparation to later have more different implementations, like sort-based shuffles.

Important: These new classes will not override any performance critical methods (like adding a buffer to the result). They merely specialize certain behaviors around checkpointing and cleanup.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)