[jira] [Created] (FLINK-9366) Distribute Cache only works for client-accessible files

[Shang Yuanchun (Jira)]

Chesnay Schepler created FLINK-9366:
---------------------------------------

             Summary: Distribute Cache only works for client-accessible files
                 Key: FLINK-9366
                 URL: https://issues.apache.org/jira/browse/FLINK-9366
             Project: Flink
          Issue Type: Bug
          Components: Client, Local Runtime
    Affects Versions: 1.5.0
            Reporter: Chesnay Schepler
             Fix For: 1.5.0


In FLINK-8620 the distributed cache was modified to the distribute files via the blob store, instead of downloading them from a distributed filesystem.

Previously, taskmanagers would download requested files from the DFS. Now, they retrieve it form the blob store. This requires the client to preemptively upload all files used with distributed cache.

As a result it is no longer possible to use the distributed cache for files that reside in a cluster-internal DFS, as the client cannot download it. This is a regression from the previous behavior and may break existing setups.

[~aljoscha] [~dawidwys]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)