Issue with using siddhi extension function with flink

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Issue with using siddhi extension function with flink

Dipanjan Mazumder
Hi ,

   i am trying to integrate siddhi with flink while trying to use siddhi extension function on deploying the job in flink cluster it is not able to find those libraries at run time , so i had to explicitly put those libraries to the /opt/flink/lib folder for the jobmanager and taskmanager , fat jar of the flink job application has those libraries but it cannot identify those extension functions at runtime and putting them to the lib folder is not a feasible choice. Can you give some pointer on this problem.. thanks in advance ..




I have tried multiple ways to load the classes using class.forname etc.. but nothing works even if the fat jar for the flink job application has the siddhi extensions in it.i don’t want to add those libraries to the jobmanage and taskmanagers lib folder everytime.




Any help will be appreciated.




Regards

Dipanjan
Reply | Threaded
Open this post in threaded view
|

Re: Issue with using siddhi extension function with flink

Till Rohrmann
Hi Dipanjan,

Please double check whether the libraries are really contained in the job
jar you are submitting because if the library is contained in this jar,
then it should be on the classpath and you should be able to load it.

Cheers,
Till

On Thu, May 20, 2021 at 3:43 PM Dipanjan Mazumder <[hidden email]> wrote:

> Hi ,
>
>    i am trying to integrate siddhi with flink while trying to use siddhi
> extension function on deploying the job in flink cluster it is not able to
> find those libraries at run time , so i had to explicitly put those
> libraries to the /opt/flink/lib folder for the jobmanager and taskmanager ,
> fat jar of the flink job application has those libraries but it cannot
> identify those extension functions at runtime and putting them to the lib
> folder is not a feasible choice. Can you give some pointer on this
> problem.. thanks in advance ..
>
>
> I have tried multiple ways to load the classes using class.forname etc..
> but nothing works even if the fat jar for the flink job application has the
> siddhi extensions in it.i don’t want to add those libraries to the
> jobmanage and taskmanagers lib folder everytime.
>
>
> Any help will be appreciated.
>
>
> Regards
>
> Dipanjan
>