[jira] [Created] (FLINK-19099) consumer kafka message repeat

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19099) consumer kafka message repeat

Shang Yuanchun (Jira)
zouwenlong created FLINK-19099:
----------------------------------

             Summary: consumer kafka message repeat
                 Key: FLINK-19099
                 URL: https://issues.apache.org/jira/browse/FLINK-19099
             Project: Flink
          Issue Type: Bug
          Components: API / DataStream, Connectors / Kafka
    Affects Versions: 1.11.0
            Reporter: zouwenlong


when taksmanager be killed ,my job consume some message , but the offset in not commit,

then restart it ,my job consume kafka message repeat,  I used checkpoint  and set 5 seconds ,

I think this is a very common problem,how to solve this problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)