Jark Wu created FLINK-12805:
-------------------------------
Summary: Introduce PartitionableTableSource for partition pruning
Key: FLINK-12805
URL:
https://issues.apache.org/jira/browse/FLINK-12805 Project: Flink
Issue Type: New Feature
Components: Table SQL / API
Reporter: Jark Wu
Assignee: Jark Wu
Many data sources are partitionable storage, e.g. HIVE, HDFS, Druid. And many queries just need to read a small subset of the total data. We can use partition information to prune or skip over files irrelevant to the user's queries. Both query optimization time and execution time can be reduced obviously, especially for a large partitioned table.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)