How to specify dependencies for an application that needs to use modified version of Flink

[Saiph Kappa]

Hi,

I'm performing some modifications on Flink (current trunk version). I want
a scala app (sbt based) to use that modified version. I'm only modifying
the flink-streaming-java module, what is the typical way to specify the
dependencies for my application in this case? Should I copy all jars to the
lib folder of my app, or to build a big fat jar? how do the devs here do it?

Thanks.

[Jark Wu-2]

Hi Saiph,
    You can enter flink directory and run  `mvn clean install -DskipTest=true` to install all the modules (including flunk-streaming-java) into your local .m2 repository .  After that, change your app dependencies version to the version of your flink, such as “1.1-SNAPSHOT”. At last, reimport your app project.
 
- Jark Wu

> 在 2016年5月12日，上午2:33，Saiph Kappa <[hidden email]> 写道：
>
> Hi,
>
> I'm performing some modifications on Flink (current trunk version). I want
> a scala app (sbt based) to use that modified version. I'm only modifying
> the flink-streaming-java module, what is the typical way to specify the
> dependencies for my application in this case? Should I copy all jars to the
> lib folder of my app, or to build a big fat jar? how do the devs here do it?
>
> Thanks.

[Jark Wu-2]

Sorry for mistyped the command. You can enter into flink/flink-streaming-java and run `mvn clean package install -DskipTests=true` . It will install only flink-streaming-java module.

> 在 2016年5月12日，上午10:02，Jark <[hidden email]> 写道：
>
> Hi Saiph,
>    You can enter flink directory and run  `mvn clean install -DskipTest=true` to install all the modules (including flunk-streaming-java) into your local .m2 repository .  After that, change your app dependencies version to the version of your flink, such as “1.1-SNAPSHOT”. At last, reimport your app project.
>
> - Jark Wu
>
>> 在 2016年5月12日，上午2:33，Saiph Kappa <[hidden email]> 写道：
>>
>> Hi,
>>
>> I'm performing some modifications on Flink (current trunk version). I want
>> a scala app (sbt based) to use that modified version. I'm only modifying
>> the flink-streaming-java module, what is the typical way to specify the
>> dependencies for my application in this case? Should I copy all jars to the
>> lib folder of my app, or to build a big fat jar? how do the devs here do it?
>>
>> Thanks.
>

[Deepak Jha]

Hi Saiph,
I'm using a combination of both. A fat jar for application related jar and
keeping flink specific jars (eg: flink-scala, flink-clients,
flink-connecor) inside the lib.


On Wed, May 11, 2016 at 11:33 AM, Saiph Kappa <[hidden email]> wrote:

> Hi,
>
> I'm performing some modifications on Flink (current trunk version). I want
> a scala app (sbt based) to use that modified version. I'm only modifying
> the flink-streaming-java module, what is the typical way to specify the
> dependencies for my application in this case? Should I copy all jars to the
> lib folder of my app, or to build a big fat jar? how do the devs here do
> it?
>
> Thanks.
>

--
Thanks,
Deepak Jha

[Flavio Pompermaier]

Since FLINK-1827 was merged you could also skip test compilation with
-Dmaven.test.skip=true if you don't want to waste time and resources :)
On 12 May 2016 10:06, "Jark" <[hidden email]> wrote:

> Sorry for mistyped the command. You can enter into
> flink/flink-streaming-java and run `mvn clean package install
> -DskipTests=true` . It will install only flink-streaming-java module.
>
> > 在 2016年5月12日，上午10:02，Jark <[hidden email]> 写道：
> >
> > Hi Saiph,
> >    You can enter flink directory and run  `mvn clean install
> -DskipTest=true` to install all the modules (including
> flunk-streaming-java) into your local .m2 repository .  After that, change
> your app dependencies version to the version of your flink, such as
> “1.1-SNAPSHOT”. At last, reimport your app project.
> >
> > - Jark Wu
> >
> >> 在 2016年5月12日，上午2:33，Saiph Kappa <[hidden email]> 写道：
> >>
> >> Hi,
> >>
> >> I'm performing some modifications on Flink (current trunk version). I
> want
> >> a scala app (sbt based) to use that modified version. I'm only modifying
> >> the flink-streaming-java module, what is the typical way to specify the
> >> dependencies for my application in this case? Should I copy all jars to
> the
> >> lib folder of my app, or to build a big fat jar? how do the devs here
> do it?
> >>
> >> Thanks.
> >
>
>