[jira] [Created] (FLINK-5859) support partition pruning on Table API & SQL

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5859) support partition pruning on Table API & SQL

Shang Yuanchun (Jira)
godfrey he created FLINK-5859:
---------------------------------

             Summary: support partition pruning on Table API & SQL
                 Key: FLINK-5859
                 URL: https://issues.apache.org/jira/browse/FLINK-5859
             Project: Flink
          Issue Type: New Feature
          Components: Table API & SQL
            Reporter: godfrey he
            Assignee: godfrey he


Many data sources are partitionable storage, e.g. HDFS, Druid. And many queries just need to read a small subset of the total data. We can use partition information to prune or skip over files irrelevant to the user’s queries. Both query optimization time and execution time can be reduced obviously, especially for a large partitioned table.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)