[DISCUSS] Flink Nebula Connector

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS] Flink Nebula Connector

Darion Yaphet
Hi developers,
I hope you are well and safe! This is Chenguang Wang with vesoft.inc. It is
a high-tech startup and the team is developing an open-source distributed
graph database, i.e. Nebula Graph.

A lot of Nebula Graph users are using Flink as their computation engine.
The problem is, they need to develop a program on their own to write data
from Flink to Nebula Graph, which is painful.

Therefore, to provide a smoother experience connecting Flink and Nebula
Graph, I am writing to see if it is possible that the Nebula Graph team
provides a connector, which can directly write data from Flink to Nebula
Graph.

Looking forward to hearing from you.

Have a good day!

Regards,



--

long is the way and hard  that out of Hell leads up to light
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Flink Nebula Connector

Konstantin Knauf-4
Hi Darion,

The Apache Flink community has become careful including additional
connectors in the core repository and project. In our experience,
connectors require quite a lot of maintenance over a long time and
end-to-end tests put a burden on the CI. This is particularly difficult if
there are no committers with knowledge of the third party system.
Therefore, I would personally recommend publishing your connector in a
separate Github repository and adding it to https://flink-packages.org/.
This is the fastest way to make it available to the community and to get
adoption. Apache Bahir might be another option.

Cheers,

Konstantin

On Wed, Oct 21, 2020 at 4:53 AM Darion Yaphet <[hidden email]>
wrote:

> Hi developers,
> I hope you are well and safe! This is Chenguang Wang with vesoft.inc. It is
> a high-tech startup and the team is developing an open-source distributed
> graph database, i.e. Nebula Graph.
>
> A lot of Nebula Graph users are using Flink as their computation engine.
> The problem is, they need to develop a program on their own to write data
> from Flink to Nebula Graph, which is painful.
>
> Therefore, to provide a smoother experience connecting Flink and Nebula
> Graph, I am writing to see if it is possible that the Nebula Graph team
> provides a connector, which can directly write data from Flink to Nebula
> Graph.
>
> Looking forward to hearing from you.
>
> Have a good day!
>
> Regards,
>
>
>
> --
>
> long is the way and hard  that out of Hell leads up to light
>


--

Konstantin Knauf

https://twitter.com/snntrable

https://github.com/knaufk