[jira] [Created] (FLINK-16413) Reduce hive source parallelism when limit push down

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16413) Reduce hive source parallelism when limit push down

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-16413:
------------------------------------

             Summary: Reduce hive source parallelism when limit push down
                 Key: FLINK-16413
                 URL: https://issues.apache.org/jira/browse/FLINK-16413
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
            Reporter: Jingsong Lee
             Fix For: 1.11.0


User started hive source parallelism automatic inference. For example, Set the maximum parallelism of inference to 10.

User have a similar SQL SELECT * from mytable limit 1;

There are more than 10 files in the hive table mytable. Is it a bit wasteful to start 10 parallelism.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)