[jira] [Created] (FLINK-5812) Clean up FileSystem

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5812) Clean up FileSystem

Shang Yuanchun (Jira)
Stephan Ewen created FLINK-5812:
-----------------------------------

             Summary: Clean up FileSystem
                 Key: FLINK-5812
                 URL: https://issues.apache.org/jira/browse/FLINK-5812
             Project: Flink
          Issue Type: Improvement
          Components: Core
    Affects Versions: 1.2.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
            Priority: Minor
             Fix For: 1.3.0


The {{FileSystem}} class is overloaded and has methods that are not well supported. I suggest to do the following cleanups:

  - Pull the safety net into a separate class

  - Use the {{WriteMode}} to indicate overwriting behavior. Right now, the {{FileSystem}} class defines that enum and never uses it. It feels weird.

  - Remove the {{create(path, overwrite, blocksize, reolication, ...)}} method, which is not really supported across file system implementations. For HDFS, behavior should be set via the configuration anyways.

All changes have to be made in a non-API-breaking fashion.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)