[jira] [Created] (FLINK-10989) OrcRowInputFormat uses two different file systems

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-10989) OrcRowInputFormat uses two different file systems

Shang Yuanchun (Jira)
Till Rohrmann created FLINK-10989:
-------------------------------------

             Summary: OrcRowInputFormat uses two different file systems
                 Key: FLINK-10989
                 URL: https://issues.apache.org/jira/browse/FLINK-10989
             Project: Flink
          Issue Type: Bug
          Components: Batch Connectors and Input/Output Formats
    Affects Versions: 1.7.0
            Reporter: Till Rohrmann


The {{OrcRowInputFormat}} seems to use two different {{FileSystem}}. The Flink {{FileSystem}} for listing the files and generating the {{InputSplits}} and then Hadoop's {{FileSystem}} to actually read the input splits. This can be problematic if one only configures Flink's S3 {{FileSystem}} but does not provide a S3 implementation for Hadoop's {{FileSystem}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)