[jira] [Created] (FLINK-16416) Shutdown the task manager gracefully in standalone mode

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16416) Shutdown the task manager gracefully in standalone mode

Shang Yuanchun (Jira)
Yangze Guo created FLINK-16416:
----------------------------------

             Summary: Shutdown the task manager gracefully in standalone mode
                 Key: FLINK-16416
                 URL: https://issues.apache.org/jira/browse/FLINK-16416
             Project: Flink
          Issue Type: Improvement
          Components: Command Line Client
            Reporter: Yangze Guo


Recently, I try to add a new {{GPUManager}} to the {{TaskExecutorServices}}. I register the "close", in which I write some cleanup logic, function to the {{TaskExecutorServices#shutDown}}. However, I found that the cleanup logic does not run as expected in standalone mode.
After an investigation in the codebase, I found that the {{TaskExecutorServices#shutDown}} will be called only on a fatal error while we just kill the TM process in the {{flink-daemon.sh}}. However, the LOG shows that some services did clean up themselves by registering {{shutdownHook}}.
If that is the right way, then we need to register a {{shutdownHook}} for {{TaskExecutorServices}} as well.
If that is not, we may find another solution to shutdown TM gracefully.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)