[jira] [Created] (FLINK-18676) Update version of aws to support use of default constructor of "WebIdentityTokenCredentialsProvider"

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18676) Update version of aws to support use of default constructor of "WebIdentityTokenCredentialsProvider"

Shang Yuanchun (Jira)
Ravi Bhushan Ratnakar created FLINK-18676:
---------------------------------------------

             Summary: Update version of aws to support use of default constructor of "WebIdentityTokenCredentialsProvider"
                 Key: FLINK-18676
                 URL: https://issues.apache.org/jira/browse/FLINK-18676
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / FileSystem
    Affects Versions: 1.11.0
            Reporter: Ravi Bhushan Ratnakar


*Background:*

I am using Flink 1.11.0 on kubernetes platform. To give access of aws services to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I have configured below property in flink-conf.yaml to use credential provider.

fs.s3a.aws.credentials.provider: com.amazonaws.auth.WebIdentityTokenCredentialsProvider

 

*Issue:*

When taskmanager/jobmanager is starting up, during this it complains that "WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and container doesn't come up.

 

*Solution:*

Currently the above credential's class is being used from "*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from "*flink-s3-fs-base*". In *"flink-s3-fs-base",*  version of aws [fs.s3.aws.version|[https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]] is 1.11.754 . The support of default constructor for "WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and onward.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)