[jira] [Created] (FLINK-17502) More granular source parsing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17502) More granular source parsing

Shang Yuanchun (Jira)
Karim Mansour created FLINK-17502:
-------------------------------------

             Summary: More granular source parsing
                 Key: FLINK-17502
                 URL: https://issues.apache.org/jira/browse/FLINK-17502
             Project: Flink
          Issue Type: New Feature
          Components: Connectors/ RabbitMQ
            Reporter: Karim Mansour


Currently the {{RMQSource}} is extracting the body of the message which is a byte array and pass it to a an instance of a user implementation of the {{DeserializationSchema}} class to deserialize the body of the message. It also uses the correlation id from the message properties to deduplicate the message.

What will be done is creating a new {{RMQSource}} constructor that is instead of taking a implementation of a {{DeserializationSchema}} in the {{RMQSource}} constructor, actually have the user implement an interface that would have methods to extract both the correlation id and message not only from the body of the message but also from it's metadata and properties thus giving the connector much more power and flexibility.
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)