[jira] [Created] (FLINK-13603) Flink Table ApI not working with nested Json schema starting From 1.6.x

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13603) Flink Table ApI not working with nested Json schema starting From 1.6.x

Shang Yuanchun (Jira)
Yu Du created FLINK-13603:
-----------------------------

             Summary: Flink Table ApI not working with nested Json schema starting From 1.6.x
                 Key: FLINK-13603
                 URL: https://issues.apache.org/jira/browse/FLINK-13603
             Project: Flink
          Issue Type: Bug
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / API
    Affects Versions: 1.8.1, 1.7.2, 1.6.4
            Reporter: Yu Du
         Attachments: FlinkTableBugCode, jsonSchema.json, jsonSchema2.json

starting from Flink 1.6.2 , some schema not working when have nested object .

issue like :  Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Column 'data.interaction.action_type' not found in table 

Even we can see that column from Table Schema .

And the same schema and query working on 1.5.2 , but not working for 1.6.x , 1.7.x and 1.8.x

 

I tried to dive into the bug, and found the root cause is calcite library doesn't mapping the column name with the correct Row type . 

I checked Flink 1.6 using the same version of Calcite as Flink 1.5 .  Not sure if Calcite is the root cause of this issue .

Attached with the code sample and two issue json schemas . both examples give column not found exception .

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)