[jira] [Created] (FLINK-12149) Support Proto for Streaming File Sink

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12149) Support Proto for Streaming File Sink

Shang Yuanchun (Jira)
Kailash Hassan Dayanand created FLINK-12149:
-----------------------------------------------

             Summary: Support Proto for Streaming File Sink
                 Key: FLINK-12149
                 URL: https://issues.apache.org/jira/browse/FLINK-12149
             Project: Flink
          Issue Type: New Feature
            Reporter: Kailash Hassan Dayanand


Currently we are supporting AuroParquetWriters in flink here:[https://ci.apache.org/projects/flink/flink-docs-release-1.7/api/java/org/apache/flink/formats/parquet/avro/ParquetAvroWriters.html]. Supporting an protoParquetWriter within Flink will be a good addition as well. 

Currently Parquet already have support for ProtoParquetWriters here: [https://github.com/apache/parquet-mr/blob/master/parquet-protobuf/src/main/java/org/apache/parquet/proto/ProtoParquetWriter.java]. We can extend the classes from here and make it available in the appropriate format to support ProtoParquet writing. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)