[jira] [Created] (FLINK-7137) Flink table API defaults top level fields as nullable and all nested fields within CompositeType as non-nullable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-7137) Flink table API defaults top level fields as nullable and all nested fields within CompositeType as non-nullable

Shang Yuanchun (Jira)
Rong Rong created FLINK-7137:
--------------------------------

             Summary: Flink table API defaults top level fields as nullable and all nested fields within CompositeType as non-nullable
                 Key: FLINK-7137
                 URL: https://issues.apache.org/jira/browse/FLINK-7137
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.3.1
            Reporter: Rong Rong


Right now FlinkTypeFactory does conversion between Flink TypeInformation to Calcite RelDataType by assuming the following:

All top level fields will be set to nullable and all nested fields within CompositeRelDataType and GenericRelDataType will be set to Calcite default (which is non-nullable).

This triggers Calcite SQL optimization engine drop all `IS NOT NULL` clause on nested fields, and would not be able to optimize when top level fields were actually non-nullable.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)