[DISCUSS] FLIP-166: Flink/Pinot Connector

[Yupeng Fu-2]

Hi all,

I'd like to propose a Flink/Pinot connector to solve the problems of
streaming/batch unification for the real-time analytical infrastructure on
top of Flink and Pinot. Apache Pinot <https://docs.pinot.apache.org/> is a
real-time distributed OLAP datastore with an inbuilt lambda architecture.
With the Flink/Pinot connector, Pinot's streaming/batch ingestion pipelines
can be unified using Flink only. Please read more in the FLIP proposal
<https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177045634>,
and share comments.

Thanks,

--
--Yupeng

[Henry Saputra]

I think this is good contribution to Apache Bahir:

https://github.com/apache/bahir-flink

as proper place to additional Flink connectors.

- Henry

On Tue, Mar 2, 2021, 11:35 AM Yupeng Fu <[hidden email]> wrote:

> Hi all,
>
> I'd like to propose a Flink/Pinot connector to solve the problems of
> streaming/batch unification for the real-time analytical infrastructure on
> top of Flink and Pinot. Apache Pinot <https://docs.pinot.apache.org/> is a
> real-time distributed OLAP datastore with an inbuilt lambda architecture.
> With the Flink/Pinot connector, Pinot's streaming/batch ingestion pipelines
> can be unified using Flink only. Please read more in the FLIP proposal
> <
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177045634
> >,
> and share comments.
>
> Thanks,
>
> --
> --Yupeng
>