[jira] [Created] (FLINK-1929) Add code to cleanly stop a running streaming topology

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1929) Add code to cleanly stop a running streaming topology

Shang Yuanchun (Jira)
Robert Metzger created FLINK-1929:
-------------------------------------

             Summary: Add code to cleanly stop a running streaming topology
                 Key: FLINK-1929
                 URL: https://issues.apache.org/jira/browse/FLINK-1929
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.9
            Reporter: Robert Metzger


Right now its not possible to cleanly stop a running Streaming topology.

Cancelling the job will cancel all operators, but for proper exactly once processing from Kafka sources, we need to provide a way to stop the sources first, wait until all remaining tuples have been processed and then shut down the sources (so that they can commit the right offset to Zookeeper).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)