[DISCUSS] FLINK-15447: Change "java.io.tmpdir" of JM/TM on Yarn to "{{PWD}}/tmp"

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS] FLINK-15447: Change "java.io.tmpdir" of JM/TM on Yarn to "{{PWD}}/tmp"

Victor Wong
Hi,

Currently, the "java.io.tmpdir" property of Flink on Yarn is set to
"/tmp", which may cause exceptions in case of a full "/tmp" directory,
especially when the user depends on some third-party libraries using
"java.io.tmpdir"
to store files.

I would like to suggest to use the working directory of the Yarn container
as "java.io.tmpdir", e.g. "{{PWD}}/tmp", which is owned by each application
and will be cleaned after the application finished.

There are some +1s in the Flink issue[1], I'd like to ask for more
suggestions on this, or assign the ticket to me if consensus has emerged.

Thanks!

[1]. https://issues.apache.org/jira/browse/FLINK-15447
--

Best,
Victor