[jira] [Resolved] (FLINK-882) DistCache: executable flag, directories

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (FLINK-882) DistCache: executable flag, directories

Shang Yuanchun (Jira)

     [ https://issues.apache.org/jira/browse/FLINK-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Metzger resolved FLINK-882.
----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.6-incubating
         Assignee: Chesnay Schepler

This was a GitHub pull request from the old repository that has been merged: https://github.com/apache/incubator-flink/pull/3

> DistCache: executable flag, directories
> ---------------------------------------
>
>                 Key: FLINK-882
>                 URL: https://issues.apache.org/jira/browse/FLINK-882
>             Project: Flink
>          Issue Type: Bug
>            Reporter: GitHub Import
>            Assignee: Chesnay Schepler
>              Labels: github-import
>             Fix For: pre-apache, 0.6-incubating
>
>         Attachments: pull-request-882-6600334915844166448.patch
>
>
> new features:
> - you can now distribute whole directories (this copies all files tracked by ``listStatus`` recursively)
> - when distributing single files they can be tagged as executable (automatically checked for local files)
> other changes:
> - the name/path scheme was changed to preserve the original name. all files are now stored in a job-specific folder, instead of having a job/identifier specific name.
> - the arguments passed when registering a file are abstracted away in its own data structure, making it easier to expand the DC the future. (there is no reason why one should have to change ``NepheleJobGraphGenerator`` or ``TaskManager`` for this)
> - reworded/expanded some javadocs, and made it clear that local files can only be used when they are accessible form all workers
> sidenotes:
> - ``FileCache.CopyProcess.create()`` is basically a copy function. i think we could add this as a static method to ``FileSystem`` as ``copy(URI sourcePath, URI targetPath)``.
> - the code will be tested with the python interface
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/pull/882
> Created by: [zentol|https://github.com/zentol]
> Labels:
> Created at: Wed May 28 23:24:41 CEST 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.2#6252)