[jira] [Created] (FLINK-14679) Add total number of partitions to ResultPartitionDeploymentDescriptor

[Shang Yuanchun (Jira)]

Chesnay Schepler created FLINK-14679:
----------------------------------------

             Summary: Add total number of partitions to ResultPartitionDeploymentDescriptor
                 Key: FLINK-14679
                 URL: https://issues.apache.org/jira/browse/FLINK-14679
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
            Reporter: Chesnay Schepler
            Assignee: Chesnay Schepler
             Fix For: 1.10.0


The ResourceManager requires some way to tell whether it has received all partitions for a given dataset; to ensure that a) no incomplete datasets are shows to the user [as completed] and b) to initiate a timeout-based cleanup of other partitions.

Conversely, since the RM only has access to what the TaskExecutor sends, this information must also be accessible to the TE.

A good candidate for placing this seems to be the {{ResultPartitionDeploymentDescriptor}} or {{PartitionDescriptor}}, as these already contain the DataSetID.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)