[jira] [Created] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

Shang Yuanchun (Jira)
Tzu-Li (Gordon) Tai created FLINK-5018:
------------------------------------------

             Summary: User configurable source idle timeout to work with WatermarkStatus emitting
                 Key: FLINK-5018
                 URL: https://issues.apache.org/jira/browse/FLINK-5018
             Project: Flink
          Issue Type: Sub-task
          Components: Streaming
            Reporter: Tzu-Li (Gordon) Tai


There are 2 cases where sources are considered idle and should emit an idle {{WatermarkStatus}} downstream, taking Kafka consumer as example:
- The source instance was not assigned any partitions
- The source instance was assigned partitions, but they currently don't have any data.

For the second case, we can only consider it idle after a timeout threshold. It would be good to make this timeout user configurable besides a default value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)