[jira] [Created] (FLINK-14265) Don't use ContinuousFileReaderOperator to support multiple paths

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14265) Don't use ContinuousFileReaderOperator to support multiple paths

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-14265:
------------------------------------

             Summary: Don't use ContinuousFileReaderOperator to support multiple paths
                 Key: FLINK-14265
                 URL: https://issues.apache.org/jira/browse/FLINK-14265
             Project: Flink
          Issue Type: Sub-task
          Components: Table SQL / Planner
            Reporter: Jingsong Lee
             Fix For: 1.10.0


Now, blink planner use ContinuousFileReaderOperator to support InputFormat, but ContinuousFileReaderOperator not support multiple paths.

If read partitioned source, after partition pruning, we need let InputFormat to read multiple partitions which are multiple paths.

We can use InputFormatSourceFunction directly to support InputFormat.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)