[jira] [Created] (FLINK-22748) Allow dynamic target topic selection in Kafka sinks

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-22748) Allow dynamic target topic selection in Kafka sinks

Shang Yuanchun (Jira)
Timo Walther created FLINK-22748:
------------------------------------

             Summary: Allow dynamic target topic selection in Kafka sinks
                 Key: FLINK-22748
                 URL: https://issues.apache.org/jira/browse/FLINK-22748
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / Ecosystem
            Reporter: Timo Walther


We should allow to write to different Kafka topics based on some column value in SQL.

The existing implementation can be easily adapted for that. The "target topic" would be an additional persisted metadata column in SQL terms. All one need to do is to adapt

DynamicKafkaSerializationSchema

KafkaDynamicSink

We should guard this dynamic behavior via a config option and make the topic option optional in this case.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)