[jira] [Created] (FLINK-19460) AWS Kinesis Producer EXACTLY_ONCE semantic

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19460) AWS Kinesis Producer EXACTLY_ONCE semantic

Shang Yuanchun (Jira)
Chris Slotterback created FLINK-19460:
-----------------------------------------

             Summary: AWS Kinesis Producer EXACTLY_ONCE semantic
                 Key: FLINK-19460
                 URL: https://issues.apache.org/jira/browse/FLINK-19460
             Project: Flink
          Issue Type: Improvement
            Reporter: Chris Slotterback


Wanted to create a ticket to discuss adding EXACTLY_ONCE semantics to the AWS Kinesis producer, similar to how the Kafka producer functions.

The kinesis producer would need to be modified to participate in commits, per kinesis:
{noformat}
Each PutRecords request can support up to 500 records. Each record in the request can be as large as 1 MiB, up to a limit of 5 MiB for the entire request, including partition keys. Each shard can support writes up to 1,000 records per second, up to a maximum data write total of 1 MiB per second.
{noformat}

Order is not guaranteed when writing to kinesis.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)