[jira] [Created] (FLINK-19098) Make Rowdata converters public

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19098) Make Rowdata converters public

Shang Yuanchun (Jira)
Brian Zhou created FLINK-19098:
----------------------------------

             Summary: Make Rowdata converters public
                 Key: FLINK-19098
                 URL: https://issues.apache.org/jira/browse/FLINK-19098
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
    Affects Versions: 1.11.0
            Reporter: Brian Zhou


Some of the Rowdata converters(SeDer between Rowdata and format objects like GenericRecord/JsonNode) are private or package-private (like Json), this is not easy for other third-party connector projects to utilize to implement its own format factory in Table API.

For example, Pravega connector is now developing a schema-registry-based format factory. The [Pravega schema registry|https://github.com/pravega/schema-registry] is a rest service similar with confluent registry , but it can help to serialize/deserialize json/avro/protobuf/custom format data. It will help a lot if these converters are public.

Noticed in FLINK-16048, we have already moved the avro converters out and made them public. Similarly, it should be safe to make at least json and csv format converters public.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)