[jira] [Created] (FLINK-3274) Prefix Kafka connector accumulators with unique id

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3274) Prefix Kafka connector accumulators with unique id

Shang Yuanchun (Jira)
Robert Metzger created FLINK-3274:
-------------------------------------

             Summary: Prefix Kafka connector accumulators with unique id
                 Key: FLINK-3274
                 URL: https://issues.apache.org/jira/browse/FLINK-3274
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.0.0
            Reporter: Robert Metzger
            Assignee: Robert Metzger


Flink might chain together two data sinks under certain conditions.
In that case, the metrics accumulators will have a name clash (each task can have an accumulator only once, with chaining multiple sinks are sharing a task).

Also, when merging accumulators from different tasks for a per-job result, having multiple kafka producers or consumers will lead to wrong results as the merging happens only on a per-name basis.

With this issue, I'd like to introduce a unique id for consumers and producers when registering accumulators



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)