[jira] [Created] (FLINK-18508) Dynamic source supports statistics and parallelism report

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18508) Dynamic source supports statistics and parallelism report

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-18508:
------------------------------------

             Summary: Dynamic source supports statistics and parallelism report
                 Key: FLINK-18508
                 URL: https://issues.apache.org/jira/browse/FLINK-18508
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / API
            Reporter: Jingsong Lee
             Fix For: 1.12.0


Add SupportsStatisticsReport and SupportsParallelismReport to dynamic source, source can return some information to help table optimizer.

This information can be more accurate from the source rather than the catalog. For example, for iceberg / filesystem connector, after filter and partition pushdown, the statistics have been greatly adjusted, and many files may have been filtered out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)