Add jobId and JobName variable to JobManager metrics in per-job deployment mode

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Add jobId and JobName variable to JobManager metrics in per-job deployment mode

Lu Niu
Hi, Flink dev

Could you share your thoughts about
https://issues.apache.org/jira/browse/FLINK-22164 ?

context:
We expose all flink metrics to an external system for monitoring and
alerting. However, JobManager metrics only have one variable <hostname>,
which is not enough to target to one job when job is deployed to YARN. If
flink job runs in per-job mode, which ensure one job per cluster, we can
add jobId and JobName to JobMananger metrics.


Best
Lu
Reply | Threaded
Open this post in threaded view
|

Re: Add jobId and JobName variable to JobManager metrics in per-job deployment mode

Till Rohrmann
Hi Lu,

thanks for reaching out to the dev community. I would suggest keeping the
discussion on the JIRA ticket.

Cheers,
Till

On Tue, Apr 13, 2021 at 11:59 PM Lu Niu <[hidden email]> wrote:

> Hi, Flink dev
>
> Could you share your thoughts about
> https://issues.apache.org/jira/browse/FLINK-22164 ?
>
> context:
> We expose all flink metrics to an external system for monitoring and
> alerting. However, JobManager metrics only have one variable <hostname>,
> which is not enough to target to one job when job is deployed to YARN. If
> flink job runs in per-job mode, which ensure one job per cluster, we can
> add jobId and JobName to JobMananger metrics.
>
>
> Best
> Lu
>