[jira] [Created] (FLINK-11820) KafkaDeserializationSchemaWrapper should filter record which value is null

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11820) KafkaDeserializationSchemaWrapper should filter record which value is null

Shang Yuanchun (Jira)
lamber-ken created FLINK-11820:
----------------------------------

             Summary: KafkaDeserializationSchemaWrapper should filter record which value is null
                 Key: FLINK-11820
                 URL: https://issues.apache.org/jira/browse/FLINK-11820
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Kafka
    Affects Versions: 1.7.2
            Reporter: lamber-ken
            Assignee: lamber-ken
             Fix For: 1.7.3


when kafka msg queue contains some records which value is null, flink-kafka-connector can't process these records.

for example, msg queue like bellow.
|msg|{color:#ff0000}null{color}|msg|msg|msg|msg|

 for normal, use +SimpleStringSchema+ to process msg queue data
{code:java}
env.addSource(new FlinkKafkaConsumer010("topic", new SimpleStringSchema(), properties));
{code}
 but, will get NullPointerException

{code:java}
java.lang.NullPointerException
        at java.lang.String.<init>(String.java:515)
        at org.apache.flink.api.common.serialization.SimpleStringSchema.deserialize(SimpleStringSchema.java:75)
        at org.apache.flink.api.common.serialization.SimpleStringSchema.deserialize(SimpleStringSchema.java:36)
{code}


 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)