[jira] [Created] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

Shang Yuanchun (Jira)
Yun Gao created FLINK-17589:
-------------------------------

             Summary: Extend StreamingFileSink to Support Streaming Hive Connector
                 Key: FLINK-17589
                 URL: https://issues.apache.org/jira/browse/FLINK-17589
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / FileSystem
            Reporter: Yun Gao
             Fix For: 1.11.0


According to the [Discussion on FLIP-115|[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]], we will use StreamingFileSink to support the streaming hive connector. This requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)