[jira] [Created] (FLINK-18562) Add Support for Azure Data Lake Store Gen 2 in Flink File System

[Shang Yuanchun (Jira)]

Israel Ekpo created FLINK-18562:
-----------------------------------

             Summary: Add Support for Azure Data Lake Store Gen 2 in Flink File System
                 Key: FLINK-18562
                 URL: https://issues.apache.org/jira/browse/FLINK-18562
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / FileSystem
    Affects Versions: 1.12.0
            Reporter: Israel Ekpo
             Fix For: 1.12.0


The objective of this improvement is to add support for Azure Data Lake Store Gen 2 (ADLS Gen2) [1] in the Flink File System [2]

This will allow include the abfs(s) scheme/protocol via ADLS Gen2 to be available as one of the distributed filesystems that can be used for savepointing, checkpointing, data sources and sinks in Flink jobs.

It will also simplify the implementation of managed identities [3] which is an added security benefit in environments where system assigned and user assigned managed identities can be leveraged.


[1] https://hadoop.apache.org/docs/current/hadoop-azure/abfs.html
[2] https://github.com/apache/flink/tree/master/flink-filesystems
[3] https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html#Using_MSI_.28Managed_Service_Identity.29



--
This message was sent by Atlassian Jira
(v8.3.4#803005)