[jira] [Created] (FLINK-22674) Provide JobID when apply shuffle resource by ShuffleMaster

[Shang Yuanchun (Jira)]

Jin Xing created FLINK-22674:
--------------------------------

             Summary: Provide JobID when apply shuffle resource by ShuffleMaster
                 Key: FLINK-22674
                 URL: https://issues.apache.org/jira/browse/FLINK-22674
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
            Reporter: Jin Xing


In current Flink 'pluggable shuffle service' framework, only PartitionDescriptor and ProducerDescriptor are included as parameters in ShuffleMaster#registerPartitionWithProducer.

But when extending a remote shuffle service based on 'pluggable shuffle service', JobID is also needed when apply shuffle resource from remote cluster. It can be used as an identification to link shuffle resource with the corresponding job:
 # Remote shuffle cluster can isolate or do capacity control on shuffle resource between jobs;
 # Remote shuffle cluster can use JobID for shuffle data cleanup when job is lost thus to avoid file leak;



--
This message was sent by Atlassian Jira
(v8.3.4#803005)