[jira] [Created] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions

[Shang Yuanchun (Jira)]

Till Rohrmann created FLINK-3542:
------------------------------------

             Summary: FlinkKafkaConsumer09 cannot handle changing number of partitions
                 Key: FLINK-3542
                 URL: https://issues.apache.org/jira/browse/FLINK-3542
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
    Affects Versions: 1.0.0
            Reporter: Till Rohrmann
            Priority: Minor


The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of partitions of a topic while running. The consumer will simply leave the newly created partitions out and thus miss all data which is written to the new partitions. The reason seems to be a static assignment of partitions to consumer tasks when the job is started.

We should either fix this behaviour or clearly document it in the online and code docs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)