[jira] [Created] (FLINK-2386) Implement Kafka connector using the new Kafka Consumer API

[Shang Yuanchun (Jira)]

Robert Metzger created FLINK-2386:
-------------------------------------

             Summary: Implement Kafka connector using the new Kafka Consumer API
                 Key: FLINK-2386
                 URL: https://issues.apache.org/jira/browse/FLINK-2386
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
            Reporter: Robert Metzger


Once Kafka has released its new consumer API, we should provide a connector for that version.
The release will probably be called 0.9 or 0.8.3.

The connector will be mostly compatible with Kafka 0.8.2.x, except for committing offsets to the broker (the new connector expects a coordinator to be available on Kafka). To work around that, we can provide a configuration option to commit offsets to zookeeper (managed by flink code).
For 0.9/0.8.3 it will be fully compatible.

It will not be compatible with 0.8.1 because of mismatching Kafka messages.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)