[jira] [Created] (FLINK-5129) make the BlobServer use a distributed file system

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5129) make the BlobServer use a distributed file system

Shang Yuanchun (Jira)
Nico Kruber created FLINK-5129:
----------------------------------

             Summary: make the BlobServer use a distributed file system
                 Key: FLINK-5129
                 URL: https://issues.apache.org/jira/browse/FLINK-5129
             Project: Flink
          Issue Type: Improvement
          Components: Network
            Reporter: Nico Kruber
            Assignee: Nico Kruber
            Priority: Minor


Currently, the BlobServer uses a local storage and, in addition when the HA mode is set, a distributed file system, e.g. hdfs. This, however, is only used by the JobManager and all TaskManager instances request blobs from the JobManager. By using the distributed file system there as well, we would lower the load on the JobManager and increase scalability.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)