[jira] [Created] (FLINK-15348) Fix orc optimization for version less than 2.3 by introducing orc shim

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15348) Fix orc optimization for version less than 2.3 by introducing orc shim

Shang Yuanchun (Jira)
Bowen Li created FLINK-15348:
--------------------------------

             Summary: Fix orc optimization for version less than 2.3 by introducing orc shim
                 Key: FLINK-15348
                 URL: https://issues.apache.org/jira/browse/FLINK-15348
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
    Affects Versions: 1.10.0, 1.11.0
            Reporter: Bowen Li
            Assignee: Jingsong Lee
             Fix For: 1.10.0, 1.11.0


Reading ORC table from Hive 2.0.1 fails with:
{noformat}
Caused by: java.lang.NoSuchMethodError: org.apache.orc.OrcFile.createReader(Lorg/apache/hadoop/fs/Path;Lorg/apache/orc/OrcFile$ReaderOptions;)Lorg/apache/orc/Reader;
        at org.apache.flink.orc.OrcSplitReader.<init>(OrcSplitReader.java:78)
        at org.apache.flink.orc.OrcColumnarRowSplitReader.<init>(OrcColumnarRowSplitReader.java:53)
        at org.apache.flink.orc.OrcSplitReaderUtil.genPartColumnarRowReader(OrcSplitReaderUtil.java:93)
        at org.apache.flink.connectors.hive.read.HiveVectorizedOrcSplitReader.<init>(HiveVectorizedOrcSplitReader.java:64)
        at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:117)
        at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:57)
        at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:85)
        at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:100)
        at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:63)
        at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:196)
{noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)