[jira] [Created] (FLINK-19211) SQL Read Decimal In Parquet Error

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19211) SQL Read Decimal In Parquet Error

Shang Yuanchun (Jira)
nyq created FLINK-19211:
---------------------------

             Summary: SQL Read Decimal In Parquet Error
                 Key: FLINK-19211
                 URL: https://issues.apache.org/jira/browse/FLINK-19211
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
    Affects Versions: 1.11.1
            Reporter: nyq


I use impala-3.2.0-cdh6.3.2 generate a parquet table with a decimal column:

     create table test (a int, b decimal(5, 1)) stored as parquet;

     insert into test values (1, 1.1), (2, 2.2), (3, 3.3);

then use sql-client on hive:

     select * from test

give an error :
{code:java}
Caused by: java.lang.UnsupportedOperationException: org.apache.flink.hive.shaded.parquet.column.values.dictionary.PlainValuesDictionary$PlainBinaryDictionary
        at org.apache.flink.hive.shaded.parquet.column.Dictionary.decodeToLong(Dictionary.java:49)
        at org.apache.flink.hive.shaded.formats.parquet.vector.ParquetDictionary.decodeToLong(ParquetDictionary.java:44)
        at org.apache.flink.table.data.vector.heap.HeapLongVector.getLong(HeapLongVector.java:49)
        at org.apache.flink.hive.shaded.formats.parquet.vector.ParquetDecimalVector.getDecimal(ParquetDecimalVector.java:50)
        at org.apache.flink.table.data.vector.VectorizedColumnBatch.getDecimal(VectorizedColumnBatch.java:115)
        at org.apache.flink.table.data.ColumnarRowData.getDecimal(ColumnarRowData.java:119)
        at org.apache.flink.table.data.RowData.get(RowData.java:276)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)