[jira] [Created] (FLINK-13537) Changing Kafka producer pool size and scaling out may create overlapping transaction IDs

[Shang Yuanchun (Jira)]

Nico Kruber created FLINK-13537:
-----------------------------------

             Summary: Changing Kafka producer pool size and scaling out may create overlapping transaction IDs
                 Key: FLINK-13537
                 URL: https://issues.apache.org/jira/browse/FLINK-13537
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
    Affects Versions: 1.8.1, 1.9.0
            Reporter: Nico Kruber


The Kafka producer's transaction IDs are only generated once when there was no previous state for that operator. In the case where we restore and increase parallelism (scale-out), some operators may not have previous state and create new IDs. Now, if we also reduce the poolSize, these new IDs may overlap with the old ones which should never happen!



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)