[jira] [Created] (FLINK-11547) JsonMappingException in DynamoDBStreamsSchema

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11547) JsonMappingException in DynamoDBStreamsSchema

Shang Yuanchun (Jira)
Devin Thomson created FLINK-11547:
-------------------------------------

             Summary: JsonMappingException in DynamoDBStreamsSchema
                 Key: FLINK-11547
                 URL: https://issues.apache.org/jira/browse/FLINK-11547
             Project: Flink
          Issue Type: Bug
          Components: Kinesis Connector
    Affects Versions: 1.8.0
            Reporter: Devin Thomson
         Attachments: full_flink_trace.txt

If DynamoDBStreamsSchema is used as the deserializer for FlinkDynamoDBStreamsConsumer, an exception occurs during deserialization of a record. The stack trace is attached.

 

This is a blocker for using DynamoDBStreamsSchema, but can be worked around by implementing a custom deserializer. The issue appears to be due to the usage of vanilla ObjectMapper:

 
{code:java}
private static final ObjectMapper MAPPER = new ObjectMapper();
{code}
When it should be using the appropriate mix-ins offered by the dynamodb stream adapter library:
{code:java}
private static final ObjectMapper MAPPER = new RecordObjectMapper();
{code}
This appears to resolve the issue, I tested by using my own deserializer implementation.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)