Including the streaming scala-api in the 0.8 release

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

Including the streaming scala-api in the 0.8 release

Paris Carbone

Hello everyone!

While the 0.8 release is on its way, I would suggest we also include the latest streaming scala-api. It is fairly stable, at least as stable as the current java streaming api it builds on and it looks quite straightforward as well for new users.

Given that the next release will take a while, we think that it will be good to expose the scala api and get some feedback early enough so we make further improvements for the next release. What do you think?

Paris
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Gyula Fóra-2
+1
I agree to include it, the only thing missing there is the streaming guide
for scala.

On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:

>
> Hello everyone!
>
> While the 0.8 release is on its way, I would suggest we also include the
> latest streaming scala-api. It is fairly stable, at least as stable as the
> current java streaming api it builds on and it looks quite straightforward
> as well for new users.
>
> Given that the next release will take a while, we think that it will be
> good to expose the scala api and get some feedback early enough so we make
> further improvements for the next release. What do you think?
>
> Paris
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Stephan Ewen
Can you cherry-pick it onto the 0.8 branch?

If that works well and the main streaming authors (Marton, Gyula, Paris,
Jonas, Gabor, ...) back that decision, I would go for it.

On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]> wrote:

> +1
> I agree to include it, the only thing missing there is the streaming guide
> for scala.
>
> On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:
>
> >
> > Hello everyone!
> >
> > While the 0.8 release is on its way, I would suggest we also include the
> > latest streaming scala-api. It is fairly stable, at least as stable as
> the
> > current java streaming api it builds on and it looks quite
> straightforward
> > as well for new users.
> >
> > Given that the next release will take a while, we think that it will be
> > good to expose the scala api and get some feedback early enough so we
> make
> > further improvements for the next release. What do you think?
> >
> > Paris
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Gyula Fóra-2
Yes, we can cherry-pick it, thats not a problem.

On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]> wrote:

> Can you cherry-pick it onto the 0.8 branch?
>
> If that works well and the main streaming authors (Marton, Gyula, Paris,
> Jonas, Gabor, ...) back that decision, I would go for it.
>
> On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]> wrote:
>
> > +1
> > I agree to include it, the only thing missing there is the streaming
> guide
> > for scala.
> >
> > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:
> >
> > >
> > > Hello everyone!
> > >
> > > While the 0.8 release is on its way, I would suggest we also include
> the
> > > latest streaming scala-api. It is fairly stable, at least as stable as
> > the
> > > current java streaming api it builds on and it looks quite
> > straightforward
> > > as well for new users.
> > >
> > > Given that the next release will take a while, we think that it will be
> > > good to expose the scala api and get some feedback early enough so we
> > make
> > > further improvements for the next release. What do you think?
> > >
> > > Paris
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Robert Metzger
Do we have any tests for the scala streaming API ?
With tests and documentation missing there is very little time.

I hope that we get the first release candidate out tomorrow.

On Mon, Jan 5, 2015 at 3:33 PM, Gyula Fóra <[hidden email]> wrote:

> Yes, we can cherry-pick it, thats not a problem.
>
> On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]> wrote:
>
> > Can you cherry-pick it onto the 0.8 branch?
> >
> > If that works well and the main streaming authors (Marton, Gyula, Paris,
> > Jonas, Gabor, ...) back that decision, I would go for it.
> >
> > On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]> wrote:
> >
> > > +1
> > > I agree to include it, the only thing missing there is the streaming
> > guide
> > > for scala.
> > >
> > > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:
> > >
> > > >
> > > > Hello everyone!
> > > >
> > > > While the 0.8 release is on its way, I would suggest we also include
> > the
> > > > latest streaming scala-api. It is fairly stable, at least as stable
> as
> > > the
> > > > current java streaming api it builds on and it looks quite
> > > straightforward
> > > > as well for new users.
> > > >
> > > > Given that the next release will take a while, we think that it will
> be
> > > > good to expose the scala api and get some feedback early enough so we
> > > make
> > > > further improvements for the next release. What do you think?
> > > >
> > > > Paris
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Márton Balassi
In reply to this post by Stephan Ewen
+1 for the proposal.
Cherry-pick: Can do, does not depend on the other big PR merged since the
branch off (Till's). Assembling it in a moment.

Marton

On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]> wrote:

> Can you cherry-pick it onto the 0.8 branch?
>
> If that works well and the main streaming authors (Marton, Gyula, Paris,
> Jonas, Gabor, ...) back that decision, I would go for it.
>
> On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]> wrote:
>
> > +1
> > I agree to include it, the only thing missing there is the streaming
> guide
> > for scala.
> >
> > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:
> >
> > >
> > > Hello everyone!
> > >
> > > While the 0.8 release is on its way, I would suggest we also include
> the
> > > latest streaming scala-api. It is fairly stable, at least as stable as
> > the
> > > current java streaming api it builds on and it looks quite
> > straightforward
> > > as well for new users.
> > >
> > > Given that the next release will take a while, we think that it will be
> > > good to expose the scala api and get some feedback early enough so we
> > make
> > > further improvements for the next release. What do you think?
> > >
> > > Paris
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Gyula Fóra
In reply to this post by Robert Metzger
We don't have any tests for the scala api yet, because in 95% it just wraps
the java api, no new logic except for the aggregations which should have
tests indeed. The api itself have proper docs we just didn't update the
streaming-guide.

But I think since the streaming api is still in a beta phase its better to
have working features out for testing. This speeds up development a lot for
us.

This can be included in the release candidate even today, since its ready.

On Mon, Jan 5, 2015 at 3:36 PM, Robert Metzger <[hidden email]> wrote:

> Do we have any tests for the scala streaming API ?
> With tests and documentation missing there is very little time.
>
> I hope that we get the first release candidate out tomorrow.
>
> On Mon, Jan 5, 2015 at 3:33 PM, Gyula Fóra <[hidden email]> wrote:
>
> > Yes, we can cherry-pick it, thats not a problem.
> >
> > On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]> wrote:
> >
> > > Can you cherry-pick it onto the 0.8 branch?
> > >
> > > If that works well and the main streaming authors (Marton, Gyula,
> Paris,
> > > Jonas, Gabor, ...) back that decision, I would go for it.
> > >
> > > On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]> wrote:
> > >
> > > > +1
> > > > I agree to include it, the only thing missing there is the streaming
> > > guide
> > > > for scala.
> > > >
> > > > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]> wrote:
> > > >
> > > > >
> > > > > Hello everyone!
> > > > >
> > > > > While the 0.8 release is on its way, I would suggest we also
> include
> > > the
> > > > > latest streaming scala-api. It is fairly stable, at least as stable
> > as
> > > > the
> > > > > current java streaming api it builds on and it looks quite
> > > > straightforward
> > > > > as well for new users.
> > > > >
> > > > > Given that the next release will take a while, we think that it
> will
> > be
> > > > > good to expose the scala api and get some feedback early enough so
> we
> > > > make
> > > > > further improvements for the next release. What do you think?
> > > > >
> > > > > Paris
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Márton Balassi
Well, cherry-picking was a bit longer than expected, but is finally ready.
[1]

[1] https://github.com/apache/incubator-flink/pull/282

Best,

Marton


On Mon, Jan 5, 2015 at 3:47 PM, Gyula Fóra <[hidden email]> wrote:

> We don't have any tests for the scala api yet, because in 95% it just wraps
> the java api, no new logic except for the aggregations which should have
> tests indeed. The api itself have proper docs we just didn't update the
> streaming-guide.
>
> But I think since the streaming api is still in a beta phase its better to
> have working features out for testing. This speeds up development a lot for
> us.
>
> This can be included in the release candidate even today, since its ready.
>
> On Mon, Jan 5, 2015 at 3:36 PM, Robert Metzger <[hidden email]>
> wrote:
>
> > Do we have any tests for the scala streaming API ?
> > With tests and documentation missing there is very little time.
> >
> > I hope that we get the first release candidate out tomorrow.
> >
> > On Mon, Jan 5, 2015 at 3:33 PM, Gyula Fóra <[hidden email]> wrote:
> >
> > > Yes, we can cherry-pick it, thats not a problem.
> > >
> > > On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]> wrote:
> > >
> > > > Can you cherry-pick it onto the 0.8 branch?
> > > >
> > > > If that works well and the main streaming authors (Marton, Gyula,
> > Paris,
> > > > Jonas, Gabor, ...) back that decision, I would go for it.
> > > >
> > > > On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]>
> wrote:
> > > >
> > > > > +1
> > > > > I agree to include it, the only thing missing there is the
> streaming
> > > > guide
> > > > > for scala.
> > > > >
> > > > > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]>
> wrote:
> > > > >
> > > > > >
> > > > > > Hello everyone!
> > > > > >
> > > > > > While the 0.8 release is on its way, I would suggest we also
> > include
> > > > the
> > > > > > latest streaming scala-api. It is fairly stable, at least as
> stable
> > > as
> > > > > the
> > > > > > current java streaming api it builds on and it looks quite
> > > > > straightforward
> > > > > > as well for new users.
> > > > > >
> > > > > > Given that the next release will take a while, we think that it
> > will
> > > be
> > > > > > good to expose the scala api and get some feedback early enough
> so
> > we
> > > > > make
> > > > > > further improvements for the next release. What do you think?
> > > > > >
> > > > > > Paris
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Márton Balassi
If no objections I'd like to merge the update during the afternoon.

On Tue, Jan 6, 2015 at 12:32 AM, Márton Balassi <[hidden email]>
wrote:

> Well, cherry-picking was a bit longer than expected, but is finally ready.
> [1]
>
> [1] https://github.com/apache/incubator-flink/pull/282
>
> Best,
>
> Marton
>
>
> On Mon, Jan 5, 2015 at 3:47 PM, Gyula Fóra <[hidden email]> wrote:
>
>> We don't have any tests for the scala api yet, because in 95% it just
>> wraps
>> the java api, no new logic except for the aggregations which should have
>> tests indeed. The api itself have proper docs we just didn't update the
>> streaming-guide.
>>
>> But I think since the streaming api is still in a beta phase its better to
>> have working features out for testing. This speeds up development a lot
>> for
>> us.
>>
>> This can be included in the release candidate even today, since its ready.
>>
>> On Mon, Jan 5, 2015 at 3:36 PM, Robert Metzger <[hidden email]>
>> wrote:
>>
>> > Do we have any tests for the scala streaming API ?
>> > With tests and documentation missing there is very little time.
>> >
>> > I hope that we get the first release candidate out tomorrow.
>> >
>> > On Mon, Jan 5, 2015 at 3:33 PM, Gyula Fóra <[hidden email]> wrote:
>> >
>> > > Yes, we can cherry-pick it, thats not a problem.
>> > >
>> > > On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]>
>> wrote:
>> > >
>> > > > Can you cherry-pick it onto the 0.8 branch?
>> > > >
>> > > > If that works well and the main streaming authors (Marton, Gyula,
>> > Paris,
>> > > > Jonas, Gabor, ...) back that decision, I would go for it.
>> > > >
>> > > > On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]>
>> wrote:
>> > > >
>> > > > > +1
>> > > > > I agree to include it, the only thing missing there is the
>> streaming
>> > > > guide
>> > > > > for scala.
>> > > > >
>> > > > > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]>
>> wrote:
>> > > > >
>> > > > > >
>> > > > > > Hello everyone!
>> > > > > >
>> > > > > > While the 0.8 release is on its way, I would suggest we also
>> > include
>> > > > the
>> > > > > > latest streaming scala-api. It is fairly stable, at least as
>> stable
>> > > as
>> > > > > the
>> > > > > > current java streaming api it builds on and it looks quite
>> > > > > straightforward
>> > > > > > as well for new users.
>> > > > > >
>> > > > > > Given that the next release will take a while, we think that it
>> > will
>> > > be
>> > > > > > good to expose the scala api and get some feedback early enough
>> so
>> > we
>> > > > > make
>> > > > > > further improvements for the next release. What do you think?
>> > > > > >
>> > > > > > Paris
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Including the streaming scala-api in the 0.8 release

Stephan Ewen
Good from my side!

On Tue, Jan 6, 2015 at 10:58 AM, Márton Balassi <[hidden email]>
wrote:

> If no objections I'd like to merge the update during the afternoon.
>
> On Tue, Jan 6, 2015 at 12:32 AM, Márton Balassi <[hidden email]>
> wrote:
>
> > Well, cherry-picking was a bit longer than expected, but is finally
> ready.
> > [1]
> >
> > [1] https://github.com/apache/incubator-flink/pull/282
> >
> > Best,
> >
> > Marton
> >
> >
> > On Mon, Jan 5, 2015 at 3:47 PM, Gyula Fóra <[hidden email]> wrote:
> >
> >> We don't have any tests for the scala api yet, because in 95% it just
> >> wraps
> >> the java api, no new logic except for the aggregations which should have
> >> tests indeed. The api itself have proper docs we just didn't update the
> >> streaming-guide.
> >>
> >> But I think since the streaming api is still in a beta phase its better
> to
> >> have working features out for testing. This speeds up development a lot
> >> for
> >> us.
> >>
> >> This can be included in the release candidate even today, since its
> ready.
> >>
> >> On Mon, Jan 5, 2015 at 3:36 PM, Robert Metzger <[hidden email]>
> >> wrote:
> >>
> >> > Do we have any tests for the scala streaming API ?
> >> > With tests and documentation missing there is very little time.
> >> >
> >> > I hope that we get the first release candidate out tomorrow.
> >> >
> >> > On Mon, Jan 5, 2015 at 3:33 PM, Gyula Fóra <[hidden email]> wrote:
> >> >
> >> > > Yes, we can cherry-pick it, thats not a problem.
> >> > >
> >> > > On Mon, Jan 5, 2015 at 3:20 PM, Stephan Ewen <[hidden email]>
> >> wrote:
> >> > >
> >> > > > Can you cherry-pick it onto the 0.8 branch?
> >> > > >
> >> > > > If that works well and the main streaming authors (Marton, Gyula,
> >> > Paris,
> >> > > > Jonas, Gabor, ...) back that decision, I would go for it.
> >> > > >
> >> > > > On Mon, Jan 5, 2015 at 3:02 PM, Gyula Fóra <[hidden email]>
> >> wrote:
> >> > > >
> >> > > > > +1
> >> > > > > I agree to include it, the only thing missing there is the
> >> streaming
> >> > > > guide
> >> > > > > for scala.
> >> > > > >
> >> > > > > On Mon, Jan 5, 2015 at 2:49 PM, Paris Carbone <[hidden email]>
> >> wrote:
> >> > > > >
> >> > > > > >
> >> > > > > > Hello everyone!
> >> > > > > >
> >> > > > > > While the 0.8 release is on its way, I would suggest we also
> >> > include
> >> > > > the
> >> > > > > > latest streaming scala-api. It is fairly stable, at least as
> >> stable
> >> > > as
> >> > > > > the
> >> > > > > > current java streaming api it builds on and it looks quite
> >> > > > > straightforward
> >> > > > > > as well for new users.
> >> > > > > >
> >> > > > > > Given that the next release will take a while, we think that
> it
> >> > will
> >> > > be
> >> > > > > > good to expose the scala api and get some feedback early
> enough
> >> so
> >> > we
> >> > > > > make
> >> > > > > > further improvements for the next release. What do you think?
> >> > > > > >
> >> > > > > > Paris
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>