[jira] [Created] (FLINK-14963) Massive Duplicated Useless Oss Message in jobmanager.log

[Shang Yuanchun (Jira)]

Eric Lee created FLINK-14963:
--------------------------------

             Summary: Massive Duplicated Useless Oss Message in jobmanager.log
                 Key: FLINK-14963
                 URL: https://issues.apache.org/jira/browse/FLINK-14963
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.9.1
            Reporter: Eric Lee
         Attachments: 7120B204-1B34-46D5-A9ED-D5BAB2D76F26.png

When I was using AliCloud Oss as the external file system for flink checkpoints, there were massive oss related logs which are useless because checkpoints can still complete successfully.

After I debugged into checkpoint coordinator and file system, I found that the root cause is the wrong use of oss sdk to check whether the target exists in hadoop fs module.

(Attached image is the screenshot of jobmanager.log)

----

Solutions:

    I have submitted a [pull request |https://github.com/aliyun/aliyun-oss-java-sdk/pull/264]in aliyun-oss-client repository and v3.8.0 has released. We can alter the oss client version with [3.8.0|https://github.com/apache/flink/blob/master/flink-filesystems/flink-oss-fs-hadoop/pom.xml#L31].


 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)