Automatically get udf's resource files from hdfs when running a job that uses hive-udf

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Automatically get udf's resource files from hdfs when running a job that uses hive-udf

Husky Zeng
Reply | Threaded
Open this post in threaded view
|

Re: Automatically get udf's resource files from hdfs when running a job that uses hive-udf

Jark Wu-2
Hi Husky,

Module is a mechanism to support built-in functions which should always be
in the classpath.
So I'm afraid it may conflict with the current mechanism to support dynamic
loading for modules.

IIUC, what you want is the `CREATE FUNCTION ... USING JAR` which is
discussed in FLINK-14055 [1].


Best,
Jark

[1]: https://issues.apache.org/jira/browse/FLINK-14055

On Tue, 22 Sep 2020 at 09:58, Husky Zeng <[hidden email]> wrote:

>
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Is-there-a-way-to-avoid-submit-hive-udf-s-resources-when-we-submit-a-job-td38204.html
>
> As the mail say,I plan to resolve this problem in my production environment
> , is there any suggestion ?
>
>
>
> --
> Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
>