Application Related Configurations

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Application Related Configurations

Ramya Ramamurthy
Hi,

I would like to know the best ways to read application configurations from
a Flink Job. Is MySQL Connectors supported, so that some application
related configurations can be read from SQL ??
How can re-read/re-load of configurations can be handled here ??

Can somebody help with some best practices?
Reply | Threaded
Open this post in threaded view
|

Re: Application Related Configurations

Till Rohrmann
Hi Ramya,

which configuration options do you wanna change at runtime? Flink's cluster
configuration is read at start up of the cluster and cannot be changed
during its lifetime. If you want to change the behaviour of an operator,
then this is possible. One way could be to use a CoMapFunction which uses
one input stream as a control stream to reconfigure the operator. The other
input stream would be the main stream which is used for processing of
streaming records.

Afaik Flink does not come with a MySQL connector. This is something you
would need to implement on your own.

Cheers,
Till

On Mon, May 27, 2019 at 8:40 AM Ramya Ramamurthy <[hidden email]> wrote:

> Hi,
>
> I would like to know the best ways to read application configurations from
> a Flink Job. Is MySQL Connectors supported, so that some application
> related configurations can be read from SQL ??
> How can re-read/re-load of configurations can be handled here ??
>
> Can somebody help with some best practices?
>