Chris Slotterback created FLINK-19460:
-----------------------------------------
Summary: AWS Kinesis Producer EXACTLY_ONCE semantic
Key: FLINK-19460
URL:
https://issues.apache.org/jira/browse/FLINK-19460 Project: Flink
Issue Type: Improvement
Reporter: Chris Slotterback
Wanted to create a ticket to discuss adding EXACTLY_ONCE semantics to the AWS Kinesis producer, similar to how the Kafka producer functions.
The kinesis producer would need to be modified to participate in commits, per kinesis:
{noformat}
Each PutRecords request can support up to 500 records. Each record in the request can be as large as 1 MiB, up to a limit of 5 MiB for the entire request, including partition keys. Each shard can support writes up to 1,000 records per second, up to a maximum data write total of 1 MiB per second.
{noformat}
Order is not guaranteed when writing to kinesis.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)