Shengkai Fang created FLINK-20058:
-------------------------------------
Summary: Improve kafka per-partition-watermark tests
Key: FLINK-20058
URL:
https://issues.apache.org/jira/browse/FLINK-20058 Project: Flink
Issue Type: Improvement
Components: Connectors / Kafka, Table SQL / API
Affects Versions: 1.12.0
Reporter: Shengkai Fang
Fix For: 1.12.0
Currenlty, we have already pushed watermark into the kafka table source. If the consumer doesn't get data from each partition, it will not output a valid watermark. In the test {{KafkaTableITCase#testPerPartitionWatermark}} the test sink will drop the record whose rowtime is late than watermark. If the consumer reads the partition where number of records in the partition is 1, the sink will receive the valid watermark when all data has been emitted. Therefore, we'd better to keep the data number in all partitions are more than 1.
Considering, we have already pushed watermark into the source, the issue FLINK-19878 has been solved.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)