[jira] [Created] (FLINK-9204) Improve visibility of records being skipped by the `DeserializationSchema` in the Kafka / Kinesis connectors

[Shang Yuanchun (Jira)]

Tzu-Li (Gordon) Tai created FLINK-9204:
------------------------------------------

             Summary: Improve visibility of records being skipped by the `DeserializationSchema` in the Kafka / Kinesis connectors
                 Key: FLINK-9204
                 URL: https://issues.apache.org/jira/browse/FLINK-9204
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector, Kinesis Connector, Metrics
            Reporter: Tzu-Li (Gordon) Tai
             Fix For: 1.6.0


Currently, users have to write some log for visibility if they are skipping some record (by returning {{null}} from the deserialization schema).

We should have better support for this natively in the connectors, either by adding logs if {{null}} is returned by the user deserialization schema, or adding counter metrics to track how many records were skipped so far.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)