[jira] [Created] (FLINK-11693) Add KafkaSerializationSchema that directly uses ProducerRecord

[Shang Yuanchun (Jira)]

Aljoscha Krettek created FLINK-11693:
----------------------------------------

             Summary: Add KafkaSerializationSchema that directly uses ProducerRecord
                 Key: FLINK-11693
                 URL: https://issues.apache.org/jira/browse/FLINK-11693
             Project: Flink
          Issue Type: New Feature
          Components: Kafka Connector
         Environment: Kafka 0.11.0.0
Flink 1.4.0
flink-connector-kafka-0.11_2.11
            Reporter: Mohammad Abareghi
            Assignee: Aegeaner


This allows using all fields that Kafka offers on {{ConsumerRecord}}, for example, timestamps and headers.

h2. Old Text
Kafka has introduced notion of Header for messages in version 0.11.0.0  https://issues.apache.org/jira/browse/KAFKA-4208.

But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.

It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)