[jira] [Created] (FLINK-8243) OrcTableSource should recursively read all files in nested directories of the input path.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-8243) OrcTableSource should recursively read all files in nested directories of the input path.

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-8243:
------------------------------------

             Summary: OrcTableSource should recursively read all files in nested directories of the input path.
                 Key: FLINK-8243
                 URL: https://issues.apache.org/jira/browse/FLINK-8243
             Project: Flink
          Issue Type: Improvement
          Components: Batch Connectors and Input/Output Formats
    Affects Versions: 1.4.0
            Reporter: Fabian Hueske
            Assignee: Fabian Hueske
            Priority: Critical
             Fix For: 1.5.0, 1.4.1


The {{OrcTableSource}} only reads files on the first level of the provided input path.

Hive's default behavior is to recursively read all nested files in the input path. We should follow this behavior and add a switch to disable recursive reading.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)