[jira] [Created] (FLINK-19335) Automatically get udf's resource files from hdfs when running a job that uses hive-udf

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19335) Automatically get udf's resource files from hdfs when running a job that uses hive-udf

Shang Yuanchun (Jira)
Husky Zeng created FLINK-19335:
----------------------------------

             Summary: Automatically  get udf's resource files from hdfs when running a job that uses hive-udf
                 Key: FLINK-19335
                 URL: https://issues.apache.org/jira/browse/FLINK-19335
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Hive
         Environment: yarn ,per-job mode
            Reporter: Husky Zeng


http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Is-there-a-way-to-avoid-submit-hive-udf-s-resources-when-we-submit-a-job-td38204.html

As the mail say,upload udf's files every time is a big trouble in my  in my production environment , which blocked our automated task submission , and lead to muti-data between hive-metastore and flink client ( Maintain multiple copies of one data in two system is easy to cause asynchronous problems) . I plan to develop a feature ——automatically  get udf's resource files from hdfs when running a job that uses hive-udf.Do you think this function is beneficial to the community? Or any suggestion?  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)