[jira] [Created] (FLINK-19589) Expose extra options in the S3 FileSystem

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19589) Expose extra options in the S3 FileSystem

Shang Yuanchun (Jira)
Padarn Wilson created FLINK-19589:
-------------------------------------

             Summary: Expose extra options in the S3 FileSystem
                 Key: FLINK-19589
                 URL: https://issues.apache.org/jira/browse/FLINK-19589
             Project: Flink
          Issue Type: Improvement
          Components: FileSystems
            Reporter: Padarn Wilson


Purpose: To expose object tagging and lifecycle options for objects created by s3 FileSystems.

The current s3 hadoop (and presto) FileSystems wrap around existing implementations (e.g for the flink-s3-fs-hadoop file system uses org.apache.hadoop's implementation). These implementation expose functions such as `setObjectTagging` when uploading objects, but these cannot be used by Flink users currently.

I propose we extend the configuration of these filesystems to expose options to see tags and lifecycle for s3 objects created by a Flink job. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)