[DISCUSS] flink connector for sink to apache/incubator-druid

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS] flink connector for sink to apache/incubator-druid

xiao dao
Dear Flink Community!
I would like to open the discussion of contributiong incubator-druid Flink
connector to Flink.

## A brief introduction to Apache/incubator-druid

Apache Druid[1] (incubating) is a real-time analytics database designed for
fast slice-and-dice analytics ("OLAP" queries) on large data sets. Druid is
most often used as a database for powering use cases where real-time ingest,
fast query performance, and high uptime are important. As such, Druid is
commonly used for powering GUIs of analytical applications, or as a backend
for highly-concurrent APIs that need fast aggregations. Nowadays, druid has
been adopted by
more and more companies[2].

## The status of druid Flink connector
The druid Flink connector we are planning to contribute is buid upon flink
1.9.1 and druid 0.16.0. The main features are:
-Sink streaming results to druid with at-least-once semantics. use data
ingestion by Tranquility which is support of druid.

## Reference
[1]  https://druid.apache.org/ <https://druid.apache.org/>  
[2]  https://druid.apache.org/druid-powered
<https://druid.apache.org/druid-powered>  

Best,
xiao dao



--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] flink connector for sink to apache/incubator-druid

qi luo
Hi Xiao Dao,

Is it possible to ingest into Druid with exactly-once guarantee?

Thanks,
Qi

On Mon, Nov 4, 2019 at 4:18 PM xiao dao <[hidden email]> wrote:

> Dear Flink Community!
> I would like to open the discussion of contributiong incubator-druid Flink
> connector to Flink.
>
> ## A brief introduction to Apache/incubator-druid
>
> Apache Druid[1] (incubating) is a real-time analytics database designed for
> fast slice-and-dice analytics ("OLAP" queries) on large data sets. Druid is
> most often used as a database for powering use cases where real-time
> ingest,
> fast query performance, and high uptime are important. As such, Druid is
> commonly used for powering GUIs of analytical applications, or as a backend
> for highly-concurrent APIs that need fast aggregations. Nowadays, druid has
> been adopted by
> more and more companies[2].
>
> ## The status of druid Flink connector
> The druid Flink connector we are planning to contribute is buid upon flink
> 1.9.1 and druid 0.16.0. The main features are:
> -Sink streaming results to druid with at-least-once semantics. use data
> ingestion by Tranquility which is support of druid.
>
> ## Reference
> [1]  https://druid.apache.org/ <https://druid.apache.org/>
> [2]  https://druid.apache.org/druid-powered
> <https://druid.apache.org/druid-powered>
>
> Best,
> xiao dao
>
>
>
> --
> Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
>