[jira] [Created] (FLINK-10525) Deserialization schema, skip data, that couldn't be properly deserialized

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-10525) Deserialization schema, skip data, that couldn't be properly deserialized

Shang Yuanchun (Jira)
Rinat Sharipov created FLINK-10525:
--------------------------------------

             Summary: Deserialization schema, skip data, that couldn't be properly deserialized
                 Key: FLINK-10525
                 URL: https://issues.apache.org/jira/browse/FLINK-10525
             Project: Flink
          Issue Type: Improvement
          Components: Core
            Reporter: Rinat Sharipov


Hi mates, in accordance with the contract of org.apache.flink.formats.avro.DeserializationSchema, it should return *null* value, when content couldn’t be deserialized.
But in most cases (for example org.apache.flink.formats.avro.AvroDeserializationSchema) method fails if data is corrupted. 
 
We’ve implemented our own SerDe class, that returns null, if data doesn’t satisfy avro schema, but it’s rather hard to maintain this functionality during migration to the latest Flink version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)