[jira] [Created] (FLINK-14907) Support to Configure Azure Storage Key via Environment Variable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14907) Support to Configure Azure Storage Key via Environment Variable

Shang Yuanchun (Jira)
Konstantin Knauf created FLINK-14907:
----------------------------------------

             Summary: Support to Configure Azure Storage Key via Environment Variable
                 Key: FLINK-14907
                 URL: https://issues.apache.org/jira/browse/FLINK-14907
             Project: Flink
          Issue Type: Improvement
          Components: FileSystems
            Reporter: Konstantin Knauf


From a security perspective it would be good to be able pass the Azure storage key via an env to the Flink Azure filesystem. Currently we only support to set it in the Flink configuration [1].

The least intrusive way, I think, would be to include a very simple {{org.apache.hadoop.fs.azure.KeyProvider}} to flink-azure-fs-hadoop, which reads the account key from an env variable called {{AZURE_STORAGE_KEY}}.

It could then be enabled in the flink-conf.yaml via:
{noformat}
fs.azure.account.keyprovider.<account_name>.blob.core.windows.net: org.apache.flink.fs.azurefs.<NewProviderClass>{noformat}
[1] [https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/filesystems/azure.html]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)