Leonid Ilyevsky created FLINK-12548:
---------------------------------------
Summary: FlinkKafkaConsumer issues configuring underlying KafkaConsumer
Key: FLINK-12548
URL:
https://issues.apache.org/jira/browse/FLINK-12548 Project: Flink
Issue Type: Bug
Components: Connectors / Kafka
Affects Versions: 1.8.0
Reporter: Leonid Ilyevsky
Attachments: KafkaError.txt
I observe two issues that are possibly related, or at least belong to the same part of the code.
I am running multiple instances of pipelines (by setting parallelism) under Flink cluster.
First problem I see is the "Error registering AppInfo mbean", see attached stack trace [^KafkaError.txt] . From the trace I understand that it tries to use consumer group id as the bean name; obviously this fails as I have multiple instances using the same group id under the same task manager.
Second problem is, the client id is not set at all (I do provide the "client.id" property when invoking FlinkKafkaConsumer constructor). This creates problems tracking consumers on Kafka side. On the other hand, I obviously do not want to set the same client id on all instances - preferably Flink should add maybe some UUID suffix to it or something to make it unique.
The same unique name could be used for that mbean, this way solving the first problem.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
