Zou created FLINK-19798:
---------------------------
Summary: Support creating hive table input splits in parallel
Key: FLINK-19798
URL:
https://issues.apache.org/jira/browse/FLINK-19798 Project: Flink
Issue Type: Improvement
Reporter: Zou
For now, we could only creating hive table input splits serially.
HiveTableInputFormat::createInputSplits cost 40s~60s for a table with 1500 partition in my tests. IMO, we could support creating splits in parallel, which will save most of the time to do this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)