[jira] [Created] (FLINK-19595) Flink SQL support S3 select

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19595) Flink SQL support S3 select

Shang Yuanchun (Jira)
liuxiaolong created FLINK-19595:
-----------------------------------

             Summary: Flink SQL support S3 select
                 Key: FLINK-19595
                 URL: https://issues.apache.org/jira/browse/FLINK-19595
             Project: Flink
          Issue Type: Improvement
            Reporter: liuxiaolong


Flink is based on S3AInputStream.java to select datas stored in Tencent COS, it will call the getObject function of AmazonS3Client.java. 

Now, Tencent COS  have already support to pushdown the CSV and Parquert file format.

In these cases, using getObject to select datas will wastes a lots of bandwidth.

So, I think Flink SQL should support S3 Select, to reduce the waste of bandwidth.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)