[jira] [Created] (FLINK-20147) "Invalid lambda deserialization" when trying to read metadata from Kafka in SQL

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20147) "Invalid lambda deserialization" when trying to read metadata from Kafka in SQL

Shang Yuanchun (Jira)
Robin Stephenson created FLINK-20147:
----------------------------------------

             Summary: "Invalid lambda deserialization" when trying to read metadata from Kafka in SQL
                 Key: FLINK-20147
                 URL: https://issues.apache.org/jira/browse/FLINK-20147
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka, Table SQL / API
    Affects Versions: 1.12.0
            Reporter: Robin Stephenson
         Attachments: stacktrace.txt

When creating a table to read from Kafka like so using the recently added support for kafka metadata in 1.12:

{noformat}
CREATE TABLE test_table (
    `foo` STRING,
     `bar` STRING,
     `record` STRING,
     `offset` BIGINT METADATA VIRTUAL
) WITH (
    'connector' = 'kafka',
    'topic' = 'kewltest.r-test.dummy',
    'key.fields' = 'foo;bar',
    'key.format' = 'json',
    'value.format' = 'json',
    'value.fields-include' = 'EXCEPT_KEY',
    'scan.startup.mode' = 'earliest-offset',
    'properties.bootstrap.servers' = '<HOST:PORT>',
    'properties.group.id' = '<CONSUMER-GROUP>'
)
{noformat}

the "offset" column causes queries of the table to fail with an exception:
Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization

Full stack trace is attached.
Left priority as default as I wasn't sure what to set it to.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)