switching to flink 0.7

[Martin Neumann]

Hej,

I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
trouble.
The functions such as FlatMap seemed to have moved and I cant find the
correct place.

how do I have to change the following line to get it to work (this worked
in 0.6)
*import org.apache.flink.api.java.functions.FlatMapFunction;*

Also (just as a side note) I saw that the package naming for maven has
changed:
*0.6-incubating-hadoop2-SNAPSHOT* ->
*0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
Was that intentional? It would be easier to work with if this is kept
consistent from one version to the next.

cheers Martin

[Vasiliki Kalavri]

Hi Martin,

you'll find the FlatMapfunction and the rest of the *Function operators
under "org.apache.flink.api.common.functions".
Note that these are now interfaces.
If you need to use open(), close() methods, then you can use the "rich"
implementations, under "org.apache.flink.api.java.functions".

This is the corresponding pull request:
https://github.com/apache/incubator-flink/pull/85 and I think the change
was already introduced in 0.6 :)

Regards,
V.



On 27 August 2014 13:06, Martin Neumann <[hidden email]> wrote:

> Hej,
>
> I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> trouble.
> The functions such as FlatMap seemed to have moved and I cant find the
> correct place.
>
> how do I have to change the following line to get it to work (this worked
> in 0.6)
> *import org.apache.flink.api.java.functions.FlatMapFunction;*
>
> Also (just as a side note) I saw that the package naming for maven has
> changed:
> *0.6-incubating-hadoop2-SNAPSHOT* ->
> *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> Was that intentional? It would be easier to work with if this is kept
> consistent from one version to the next.
>
> cheers Martin
>

[Robert Metzger]

Hi Martin,

I think there is a little error in your mail, the versions for 0.7 are
"0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
The "hadoop2" version names for the nightly builds were generated by a
script and I forgot to adopt the script to the "-incubating" version
string-change.
So the script was actually generating the wrong version string for quite
some time. While creating the release scripts and preparing the release, I
fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
versions) and the actual releases are in sync.

Sorry for the inconvenience, but using nightly builds / SNAPSHOT version is
always a slippery road ;) We are trying to mitigate the issue by releasing
more often.

Best,
Robert





On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <[hidden email]
> wrote:

> Hi Martin,
>
> you'll find the FlatMapfunction and the rest of the *Function operators
> under "org.apache.flink.api.common.functions".
> Note that these are now interfaces.
> If you need to use open(), close() methods, then you can use the "rich"
> implementations, under "org.apache.flink.api.java.functions".
>
> This is the corresponding pull request:
> https://github.com/apache/incubator-flink/pull/85 and I think the change
> was already introduced in 0.6 :)
>
> Regards,
> V.
>
>
>
> On 27 August 2014 13:06, Martin Neumann <[hidden email]> wrote:
>
> > Hej,
> >
> > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > trouble.
> > The functions such as FlatMap seemed to have moved and I cant find the
> > correct place.
> >
> > how do I have to change the following line to get it to work (this worked
> > in 0.6)
> > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> >
> > Also (just as a side note) I saw that the package naming for maven has
> > changed:
> > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > Was that intentional? It would be easier to work with if this is kept
> > consistent from one version to the next.
> >
> > cheers Martin
> >
>

[Martin Neumann]

Thanks for the help. I have it working now though its quite a bit of manual
code change to get things working again.

@Robert: My point was that "hadoop2" and "incubating" have swapped from the
last to this version. My first try was to just update the version number in
pom.xml but that failed for that reason.

cheers Martin


On Wed, Aug 27, 2014 at 3:24 PM, Robert Metzger <[hidden email]> wrote:

> Hi Martin,
>
> I think there is a little error in your mail, the versions for 0.7 are
> "0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
> The "hadoop2" version names for the nightly builds were generated by a
> script and I forgot to adopt the script to the "-incubating" version
> string-change.
> So the script was actually generating the wrong version string for quite
> some time. While creating the release scripts and preparing the release, I
> fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
> versions) and the actual releases are in sync.
>
> Sorry for the inconvenience, but using nightly builds / SNAPSHOT version is
> always a slippery road ;) We are trying to mitigate the issue by releasing
> more often.
>
> Best,
> Robert
>
>
>
>
>
> On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <
> [hidden email]
> > wrote:
>
> > Hi Martin,
> >
> > you'll find the FlatMapfunction and the rest of the *Function operators
> > under "org.apache.flink.api.common.functions".
> > Note that these are now interfaces.
> > If you need to use open(), close() methods, then you can use the "rich"
> > implementations, under "org.apache.flink.api.java.functions".
> >
> > This is the corresponding pull request:
> > https://github.com/apache/incubator-flink/pull/85 and I think the change
> > was already introduced in 0.6 :)
> >
> > Regards,
> > V.
> >
> >
> >
> > On 27 August 2014 13:06, Martin Neumann <[hidden email]> wrote:
> >
> > > Hej,
> > >
> > > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > > trouble.
> > > The functions such as FlatMap seemed to have moved and I cant find the
> > > correct place.
> > >
> > > how do I have to change the following line to get it to work (this
> worked
> > > in 0.6)
> > > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> > >
> > > Also (just as a side note) I saw that the package naming for maven has
> > > changed:
> > > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > > Was that intentional? It would be easier to work with if this is kept
> > > consistent from one version to the next.
> > >
> > > cheers Martin
> > >
> >
>

[Fabian Hueske]

We decided to do many API changes with the first incubator release to
reduce the number of changes in future releases.
Some of the changes were done to enable support for Java 8 Lambda functions.

That meant of course breaking the code of our early adopters. Sorry for
that!

Fabian


2014-08-27 15:33 GMT+02:00 Martin Neumann <[hidden email]>:

> Thanks for the help. I have it working now though its quite a bit of manual
> code change to get things working again.
>
> @Robert: My point was that "hadoop2" and "incubating" have swapped from the
> last to this version. My first try was to just update the version number in
> pom.xml but that failed for that reason.
>
> cheers Martin
>
>
> On Wed, Aug 27, 2014 at 3:24 PM, Robert Metzger <[hidden email]>
> wrote:
>
> > Hi Martin,
> >
> > I think there is a little error in your mail, the versions for 0.7 are
> > "0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
> > The "hadoop2" version names for the nightly builds were generated by a
> > script and I forgot to adopt the script to the "-incubating" version
> > string-change.
> > So the script was actually generating the wrong version string for quite
> > some time. While creating the release scripts and preparing the release,
> I
> > fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
> > versions) and the actual releases are in sync.
> >
> > Sorry for the inconvenience, but using nightly builds / SNAPSHOT version
> is
> > always a slippery road ;) We are trying to mitigate the issue by
> releasing
> > more often.
> >
> > Best,
> > Robert
> >
> >
> >
> >
> >
> > On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <
> > [hidden email]
> > > wrote:
> >
> > > Hi Martin,
> > >
> > > you'll find the FlatMapfunction and the rest of the *Function operators
> > > under "org.apache.flink.api.common.functions".
> > > Note that these are now interfaces.
> > > If you need to use open(), close() methods, then you can use the "rich"
> > > implementations, under "org.apache.flink.api.java.functions".
> > >
> > > This is the corresponding pull request:
> > > https://github.com/apache/incubator-flink/pull/85 and I think the
> change
> > > was already introduced in 0.6 :)
> > >
> > > Regards,
> > > V.
> > >
> > >
> > >
> > > On 27 August 2014 13:06, Martin Neumann <[hidden email]> wrote:
> > >
> > > > Hej,
> > > >
> > > > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > > > trouble.
> > > > The functions such as FlatMap seemed to have moved and I cant find
> the
> > > > correct place.
> > > >
> > > > how do I have to change the following line to get it to work (this
> > worked
> > > > in 0.6)
> > > > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> > > >
> > > > Also (just as a side note) I saw that the package naming for maven
> has
> > > > changed:
> > > > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > > > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > > > Was that intentional? It would be easier to work with if this is kept
> > > > consistent from one version to the next.
> > > >
> > > > cheers Martin
> > > >
> > >
> >
>