[jira] [Created] (FLINK-11320) Support user callback in Kafka sink

[Shang Yuanchun (Jira)]

Allen Wang created FLINK-11320:
----------------------------------

             Summary: Support user callback in Kafka sink
                 Key: FLINK-11320
                 URL: https://issues.apache.org/jira/browse/FLINK-11320
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
            Reporter: Allen Wang


We would like to get notified when Flink's Kafka sink successfully produces a message to the Kafka cluster for message tracing purposes. The callback should be created for the specific item being produced. Currently this functionality is inside Flink's internal code and not accessible to the user. 

This change would allow user to get callback when a message is produced in the sink:
 * Add a new interface {{UserCallbackFactory}}:
{code:java}
public interface UserCallbackFactory<IN> {
    Callback create(IN next);
}{code}

 * Add new constructor in {{FlinkKafkaProducer}} to pass in an optional argument of {{UserCallbackFactory}}
 * In the  {{FlinkKafkaProducer.invoke}} method, create a user callback given the produced item and invoke this callback.

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)