[jira] [Created] (FLINK-15806) Update recommended way to shut down detached Yarn session cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15806) Update recommended way to shut down detached Yarn session cluster

Shang Yuanchun (Jira)
Till Rohrmann created FLINK-15806:
-------------------------------------

             Summary: Update recommended way to shut down detached Yarn session cluster
                 Key: FLINK-15806
                 URL: https://issues.apache.org/jira/browse/FLINK-15806
             Project: Flink
          Issue Type: Improvement
          Components: Deployment / YARN
    Affects Versions: 1.10.0
            Reporter: Till Rohrmann
             Fix For: 1.11.0, 1.10.1


When starting a Yarn session cluster in detached mode, then it is printed that one should shut down the cluster via {{yarn application -kill}}. The problem of this approach is, however, that temporary files won't be cleaned up which remain on HDFS. Hence, I think a better way would be to reconnect via the {{yarn-session.sh}} tool and then to stop the cluster gracefully. This won't leave orphaned files behind.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)