[jira] [Created] (FLINK-11195) Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11195) Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration

Shang Yuanchun (Jira)
Mark Cho created FLINK-11195:
--------------------------------

             Summary: Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration
                 Key: FLINK-11195
                 URL: https://issues.apache.org/jira/browse/FLINK-11195
             Project: Flink
          Issue Type: Improvement
          Components: FileSystem
    Affects Versions: 1.7.0
            Reporter: Mark Cho


Currently, `createHadoopFileSystem` method does not take any parameters.

In order to delegate FileSystem creation to Hadoop FileSystem.get method, we need to pass URI and Hadoop Configuration to this abstract method.

We use a custom version of PrestoS3FileSystem by plugging our FileSystemFactory similar to `flink-filesystems/flink-s3-fs-presto` project. However, we would like to delegate our FS creation to Hadoop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)