[jira] [Created] (FLINK-13132) Allow ClusterEntrypoints use user main method to generate job graph

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13132) Allow ClusterEntrypoints use user main method to generate job graph

Shang Yuanchun (Jira)
Zhenqiu Huang created FLINK-13132:
-------------------------------------

             Summary: Allow ClusterEntrypoints use user main method to generate job graph
                 Key: FLINK-13132
                 URL: https://issues.apache.org/jira/browse/FLINK-13132
             Project: Flink
          Issue Type: Improvement
          Components: Deployment / YARN
    Affects Versions: 1.8.1, 1.8.0
            Reporter: Zhenqiu Huang
            Assignee: Zhenqiu Huang


We are building a service that can transparently deploy a job to different cluster management systems, such as Yarn and another internal system. It is very cost to download the jar and generate JobGraph in the client side. Thus, I want to propose an improvement to make Yarn Entrypoints can be configurable to use either FileJobGraphRetriever or ClassPathJobGraphRetriever. It is actually a long asking TODO in AbstractionYarnClusterDescriptor in line 887.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)