[jira] [Created] (FLINK-13062) Set ScheduleMode based on boundedness of streaming Pipeline

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13062) Set ScheduleMode based on boundedness of streaming Pipeline

Shang Yuanchun (Jira)
Aljoscha Krettek created FLINK-13062:
----------------------------------------

             Summary: Set ScheduleMode based on boundedness of streaming Pipeline
                 Key: FLINK-13062
                 URL: https://issues.apache.org/jira/browse/FLINK-13062
             Project: Flink
          Issue Type: Improvement
          Components: API / DataStream
            Reporter: Aljoscha Krettek
            Assignee: Aljoscha Krettek


The new Blink-based Table Runner needs "streaming pipelines" to be executed with {{ScheduleMode.LAZY_FROM_SOURCES}} if all sources are bounded. The current Blink code base uses a global flag for this and configures the {{StreamGraphGenerator}} accordingly.

We propose to add an {{isBounded()}} property to {{Transformation}} (formerly known as {{StreamTransformation}}). The property would only be explicitly settable on sources, other transformations inherit the property from their inputs. The {{StreamGraphGenerator}} must use {{ScheduleMode.LAZY_FROM_SOURCES}} if all sources are bounded, otherwise, it should use {{ScheduleMode.EAGER}}, as is the currently existing behaviour.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)