[jira] [Created] (FLINK-11792) Make KafkaConsumer more resilient to Kafka Broker Failures

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11792) Make KafkaConsumer more resilient to Kafka Broker Failures

Shang Yuanchun (Jira)
Konstantin Knauf created FLINK-11792:
----------------------------------------

             Summary: Make KafkaConsumer more resilient to Kafka Broker Failures
                 Key: FLINK-11792
                 URL: https://issues.apache.org/jira/browse/FLINK-11792
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Kafka
    Affects Versions: 1.7.2
            Reporter: Konstantin Knauf


When consuming from a topic with replication factor > 1, the FlinkKafkaConsumer could continue reading from this topic, when a single broker fails, by "simply" switching to the new leader `s for all lost partitions after Kafka failover. Currently, the KafkaConsumer will most likely throw in exception as topic metadata is only periodically fetched from the Kafka cluster.

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)