Ravi Bhushan Ratnakar created FLINK-18676:
---------------------------------------------
Summary: Update version of aws to support use of default constructor of "WebIdentityTokenCredentialsProvider"
Key: FLINK-18676
URL:
https://issues.apache.org/jira/browse/FLINK-18676 Project: Flink
Issue Type: Improvement
Components: Connectors / FileSystem
Affects Versions: 1.11.0
Reporter: Ravi Bhushan Ratnakar
*Background:*
I am using Flink 1.11.0 on kubernetes platform. To give access of aws services to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I have configured below property in flink-conf.yaml to use credential provider.
fs.s3a.aws.credentials.provider: com.amazonaws.auth.WebIdentityTokenCredentialsProvider
*Issue:*
When taskmanager/jobmanager is starting up, during this it complains that "WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and container doesn't come up.
*Solution:*
Currently the above credential's class is being used from "*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from "*flink-s3-fs-base*". In *"flink-s3-fs-base",* version of aws [fs.s3.aws.version|[
https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]] is 1.11.754 . The support of default constructor for "WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and onward.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)