[jira] [Created] (FLINK-14676) Introduce parallelism inference for InputFormatTableSource

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14676) Introduce parallelism inference for InputFormatTableSource

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-14676:
------------------------------------

             Summary: Introduce parallelism inference for InputFormatTableSource
                 Key: FLINK-14676
                 URL: https://issues.apache.org/jira/browse/FLINK-14676
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / Planner
            Reporter: Jingsong Lee
             Fix For: 1.10.0


FLINK-12801 has introduce parallelism setting for table, but because TableSource generate DataStream, maybe DataStream is not a real source, that will lead to some shuffle errors. So FLINK-13494 remove these implementations.

In this ticket, I would like to introduce parallelism inference only for InputFormatTableSource, the RowCount of InputFormatTableSource is more accurate than downstream stages. It is worth to automatically generate its parallelism.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)