[jira] [Created] (FLINK-18824) Support serialization for canal-json format

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18824) Support serialization for canal-json format

Shang Yuanchun (Jira)
Jark Wu created FLINK-18824:
-------------------------------

             Summary: Support serialization for canal-json format
                 Key: FLINK-18824
                 URL: https://issues.apache.org/jira/browse/FLINK-18824
             Project: Flink
          Issue Type: Sub-task
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
            Reporter: Jark Wu


Currently, canal-json format only support deserialization, but not support serialization. This is not convenient for users to writing changelogs to an message queue.

The serialization for canal-json can follow the json strcuture of Canal, but considering currently Flink can't combine UPDATE_BEFORE and UPDATE_AFTER into a single UPDATE message. We can encode UPDATE_BEFORE and UDPATE_AFTER as DELETE and INSERT canal messages.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)