[jira] [Created] (FLINK-9303) Unassign partitions from Kafka client if partitions become unavailable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-9303) Unassign partitions from Kafka client if partitions become unavailable

Shang Yuanchun (Jira)
Tzu-Li (Gordon) Tai created FLINK-9303:
------------------------------------------

             Summary: Unassign partitions from Kafka client if partitions become unavailable
                 Key: FLINK-9303
                 URL: https://issues.apache.org/jira/browse/FLINK-9303
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
            Reporter: Tzu-Li (Gordon) Tai
             Fix For: 1.6.0


Originally reported in ML:
[http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dynamically-deleting-kafka-topics-does-not-remove-partitions-from-kafkaConsumer-td19946.html]

The problem is that the Kafka consumer has no notion of "closed" partitions at the moment, so statically assigned partitions to the Kafka client is never removed and is always continuously requested for records.

This causes LOG noises as reported in the reported mail thread.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)