[jira] [Created] (FLINK-20194) KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20194) KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.

Shang Yuanchun (Jira)
Jiangjie Qin created FLINK-20194:
------------------------------------

             Summary: KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.
                 Key: FLINK-20194
                 URL: https://issues.apache.org/jira/browse/FLINK-20194
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
            Reporter: Jiangjie Qin


The {{KafkaSourceFetcherManager.commitOffsets()}} may throw NPE when there is no split fetcher. Given that such cases should usually be rare and only happens when the source is shutting down or just started. We can create a new {{KafkaPartitionSplitReader}} to commit offset and close it immediately. The main thread maybe blocked for some time, but given that there is no event to process at that point, there should be no performance concerns.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)