[jira] [Created] (FLINK-3230) Kinesis streaming producer

[Shang Yuanchun (Jira)]

Tzu-Li (Gordon) Tai created FLINK-3230:
------------------------------------------

             Summary: Kinesis streaming producer
                 Key: FLINK-3230
                 URL: https://issues.apache.org/jira/browse/FLINK-3230
             Project: Flink
          Issue Type: Sub-task
          Components: Streaming Connectors
            Reporter: Tzu-Li (Gordon) Tai


Add a FlinkKinesisProducer for the Flink Kinesis streaming connector. We will be using AWS SDK implementation for code consistency with the FlinkKinesisConsumer.

The features of FlinkKinesisProducer is rather straightforward:
1. Partition put records based on partition key.
2. Configurable put mode: Bulk put for higher throughput vs. sequential single record puts. Size of bulk should also be configurable.
3. For bulk put, user can also choose to enforce strict ordering of the result with the tradeoff of higher put latency. Ref: https://brandur.org/kinesis-order



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)