[jira] [Created] (FLINK-11395) Support for Avro StreamingFileSink

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11395) Support for Avro StreamingFileSink

Shang Yuanchun (Jira)
Elango Ganesan created FLINK-11395:
--------------------------------------

             Summary: Support for Avro StreamingFileSink
                 Key: FLINK-11395
                 URL: https://issues.apache.org/jira/browse/FLINK-11395
             Project: Flink
          Issue Type: New Feature
          Components: Streaming Connectors
            Reporter: Elango Ganesan


Current implementation for StreamingFileSink supports Rowformat for text and json files . BulkWriter has support for Parquet files . Out of the box RowFormat does not seem to be right fit for writing Avro files as avro files need to persist metadata when opening new file.  We are thinking of implementing Avro writers similar to how Parquet is implemented . I am happy to submit a PR if this approach sounds good . 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)