[jira] [Created] (FLINK-12805) Introduce PartitionableTableSource for partition pruning

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12805) Introduce PartitionableTableSource for partition pruning

Shang Yuanchun (Jira)
Jark Wu created FLINK-12805:
-------------------------------

             Summary: Introduce PartitionableTableSource for partition pruning
                 Key: FLINK-12805
                 URL: https://issues.apache.org/jira/browse/FLINK-12805
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / API
            Reporter: Jark Wu
            Assignee: Jark Wu


Many data sources are partitionable storage, e.g. HIVE, HDFS, Druid. And many queries just need to read a small subset of the total data. We can use partition information to prune or skip over files irrelevant to the user's queries. Both query optimization time and execution time can be reduced obviously, especially for a large partitioned table.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)