[DISCUSS] Flink-RocketMQ connector

[heng du]

Apache RocketMQ[1], as a cloud-native messaging and streaming platform, has
a large number of users [2] all over the world, especially in China.


Recently, more and more users have begun to use RocketMQ to integrate with
Flink, which has resulted in a large number of issues[3] and PRs[4]. So,
RocketMQ community contributors implemented a Connector for RocketMQ-Flink,
which is now maintained in the Apache RocketMQ repository[5], So far, the
connector is being used by cloud vendors as well as Internet companies.


In order to attract more developers from the Flink community to participate
in this Connector improvement, we hope to merge this connector back to the
Flink repository[6], at the same time, we will continue to polish the
existing implementation and add new features, such as table connector
support, and welcome more and more developer to work together with us to
improve this connector.


Thanks

Henry


[1] https://rocketmq.apache.org/

[2] https://rocketmq.apache.org/users/

[3] https://github.com/apache/rocketmq-externals/issues?q=is%3Aissue+flink+

[4] https://github.com/apache/rocketmq-externals/pulls?q=is%3Apr+flink

[5] https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink

[6] https://github.com/apache/flink

[Nicholas Jiang]

Hi Heng Du,

Thanks for starting the discussion.

From the user's perspective, the integration between RocketMQ and Flink is
user-friendly. I agree with you the point that polish the existing
implementation and add new features, such as table connector
support. But before that, you need to provide RocketMQ's Source and Sink
(Legacy and FLIP-27 based), TableSource and TableSink. This integration
invokes the cooperation between Flink and RocketMQ community, therefore for
this community cooperation you could negotiate with Flink community
developers like PMC etc.

Best,
Nicholas Jiang



--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

[heng du]

Dear Flink community,

Thanks for @Nicholas's reply and bridge, I am a PMC member of RocketMQ, and
developers in the RocketMQ community have been concerned about integration
with Flink for a long time, and sincerely hope developers from both
communities will work closely together to make this connector better.


Thanks.
Henry

Nicholas Jiang <[hidden email]> 于2021年3月10日周三 上午10:16写道：

> Hi Heng Du,
>
> Thanks for starting the discussion.
>
> From the user's perspective, the integration between RocketMQ and Flink is
> user-friendly. I agree with you the point that polish the existing
> implementation and add new features, such as table connector
> support. But before that, you need to provide RocketMQ's Source and Sink
> (Legacy and FLIP-27 based), TableSource and TableSink. This integration
> invokes the cooperation between Flink and RocketMQ community, therefore for
> this community cooperation you could negotiate with Flink community
> developers like PMC etc.
>
> Best,
> Nicholas Jiang
>
>
>
> --
> Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
>