[jira] [Created] (FLINK-3386) Kafka consumers should not necessarily fail on expiring data

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3386) Kafka consumers should not necessarily fail on expiring data

Shang Yuanchun (Jira)
Gyula Fora created FLINK-3386:
---------------------------------

             Summary: Kafka consumers should not necessarily fail on expiring data
                 Key: FLINK-3386
                 URL: https://issues.apache.org/jira/browse/FLINK-3386
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
    Affects Versions: 1.0.0
            Reporter: Gyula Fora


Currently if the data in a kafka topic expires while reading from it, it causes an unrecoverable failure as subsequent retries will also fail on invalid offsets.

While this might be the desired behaviour under some circumstances, it would probably be better in most cases to automatically jump to the earliest valid offset in these cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)