[jira] [Created] (FLINK-15814) Log warning when StreamingFileSink is used with bulk output formats and an ambiguous S3 scheme

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15814) Log warning when StreamingFileSink is used with bulk output formats and an ambiguous S3 scheme

Shang Yuanchun (Jira)
Seth Wiesman created FLINK-15814:
------------------------------------

             Summary: Log warning when StreamingFileSink is used with bulk output formats and an ambiguous S3 scheme
                 Key: FLINK-15814
                 URL: https://issues.apache.org/jira/browse/FLINK-15814
             Project: Flink
          Issue Type: Improvement
            Reporter: Seth Wiesman
             Fix For: 1.11.0


StreamingFileSink does not properly work with bulk output formats and s3-presto. We should log a warning when the provided scheme is 's3p' or 's3' (which is ambiguous) explaining the potential issues and encourage users to only use 's3a' which always delegates to hadoop.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)