[DISCUSS] Release Flink 1.5.1

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS] Release Flink 1.5.1

Chesnay Schepler-3
Hello,

it has been a little over a month since we've release 1.5.0. Since then
we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
enhancement to the new execution mode (FLIP-6), fixes for critical
issues in the metric system, but also features that didn't quite make it
into 1.5.0 like FLIP-6 support for the scala-shell.

I think now is a good time to start thinking about a 1.5.1 release, for
which I would volunteer as the release manager.

There are a few issues that I'm aware of that we should include in the
release [3], but I believe these should be resolved within the next days.
So that we don't overlap with with proposed 1.6 release [2] we ideally
start the release process this week.

What do you think?

[1] https://issues.apache.org/jira/projects/FLINK/versions/12343053

[2]
https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E

[3]

- https://issues.apache.org/jira/browse/FLINK-9280
- https://issues.apache.org/jira/browse/FLINK-8785
- https://issues.apache.org/jira/browse/FLINK-9567
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

vino yang
+1

2018-07-02 18:19 GMT+08:00 Chesnay Schepler <[hidden email]>:

> Hello,
>
> it has been a little over a month since we've release 1.5.0. Since then
> we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
> enhancement to the new execution mode (FLIP-6), fixes for critical issues
> in the metric system, but also features that didn't quite make it into
> 1.5.0 like FLIP-6 support for the scala-shell.
>
> I think now is a good time to start thinking about a 1.5.1 release, for
> which I would volunteer as the release manager.
>
> There are a few issues that I'm aware of that we should include in the
> release [3], but I believe these should be resolved within the next days.
> So that we don't overlap with with proposed 1.6 release [2] we ideally
> start the release process this week.
>
> What do you think?
>
> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>
> [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb
> 722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>
> [3]
>
> - https://issues.apache.org/jira/browse/FLINK-9280
> - https://issues.apache.org/jira/browse/FLINK-8785
> - https://issues.apache.org/jira/browse/FLINK-9567
>
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

shimin yang
Hi Chesnay,

It's a good idea. And I just created a pull request on Flink-9567. Please
have a look if you had some free time.

Cheers,
Shimin

On Mon, Jul 2, 2018 at 7:17 PM vino yang <[hidden email]> wrote:

> +1
>
> 2018-07-02 18:19 GMT+08:00 Chesnay Schepler <[hidden email]>:
>
> > Hello,
> >
> > it has been a little over a month since we've release 1.5.0. Since then
> > we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
> > enhancement to the new execution mode (FLIP-6), fixes for critical issues
> > in the metric system, but also features that didn't quite make it into
> > 1.5.0 like FLIP-6 support for the scala-shell.
> >
> > I think now is a good time to start thinking about a 1.5.1 release, for
> > which I would volunteer as the release manager.
> >
> > There are a few issues that I'm aware of that we should include in the
> > release [3], but I believe these should be resolved within the next days.
> > So that we don't overlap with with proposed 1.6 release [2] we ideally
> > start the release process this week.
> >
> > What do you think?
> >
> > [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
> >
> > [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb
> > 722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
> >
> > [3]
> >
> > - https://issues.apache.org/jira/browse/FLINK-9280
> > - https://issues.apache.org/jira/browse/FLINK-8785
> > - https://issues.apache.org/jira/browse/FLINK-9567
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Stephan Ewen
+1 there are many minor fixes that are important for 1.5.1

I would suggest to make 1.5.1 rather asap and consider also a 1.5.2 quite
soon for the known issues that are not yet fixed.


In the future, with the increasing test automation, we can hopefully make a
lot of minor releases fast, so fixed get to users asap


On Mon, Jul 2, 2018 at 1:25 PM, shimin yang <[hidden email]> wrote:

> Hi Chesnay,
>
> It's a good idea. And I just created a pull request on Flink-9567. Please
> have a look if you had some free time.
>
> Cheers,
> Shimin
>
> On Mon, Jul 2, 2018 at 7:17 PM vino yang <[hidden email]> wrote:
>
> > +1
> >
> > 2018-07-02 18:19 GMT+08:00 Chesnay Schepler <[hidden email]>:
> >
> > > Hello,
> > >
> > > it has been a little over a month since we've release 1.5.0. Since then
> > > we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
> > > enhancement to the new execution mode (FLIP-6), fixes for critical
> issues
> > > in the metric system, but also features that didn't quite make it into
> > > 1.5.0 like FLIP-6 support for the scala-shell.
> > >
> > > I think now is a good time to start thinking about a 1.5.1 release, for
> > > which I would volunteer as the release manager.
> > >
> > > There are a few issues that I'm aware of that we should include in the
> > > release [3], but I believe these should be resolved within the next
> days.
> > > So that we don't overlap with with proposed 1.6 release [2] we ideally
> > > start the release process this week.
> > >
> > > What do you think?
> > >
> > > [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
> > >
> > > [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb
> > > 722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
> > >
> > > [3]
> > >
> > > - https://issues.apache.org/jira/browse/FLINK-9280
> > > - https://issues.apache.org/jira/browse/FLINK-8785
> > > - https://issues.apache.org/jira/browse/FLINK-9567
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Till Rohrmann
+1.

Thanks for being the release manager Chesnay!

I just merged FLINK-9567.

Cheers,
Till

On Mon, Jul 2, 2018 at 8:48 PM Stephan Ewen <[hidden email]> wrote:

> +1 there are many minor fixes that are important for 1.5.1
>
> I would suggest to make 1.5.1 rather asap and consider also a 1.5.2 quite
> soon for the known issues that are not yet fixed.
>
>
> In the future, with the increasing test automation, we can hopefully make a
> lot of minor releases fast, so fixed get to users asap
>
>
> On Mon, Jul 2, 2018 at 1:25 PM, shimin yang <[hidden email]> wrote:
>
> > Hi Chesnay,
> >
> > It's a good idea. And I just created a pull request on Flink-9567. Please
> > have a look if you had some free time.
> >
> > Cheers,
> > Shimin
> >
> > On Mon, Jul 2, 2018 at 7:17 PM vino yang <[hidden email]> wrote:
> >
> > > +1
> > >
> > > 2018-07-02 18:19 GMT+08:00 Chesnay Schepler <[hidden email]>:
> > >
> > > > Hello,
> > > >
> > > > it has been a little over a month since we've release 1.5.0. Since
> then
> > > > we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
> > > > enhancement to the new execution mode (FLIP-6), fixes for critical
> > issues
> > > > in the metric system, but also features that didn't quite make it
> into
> > > > 1.5.0 like FLIP-6 support for the scala-shell.
> > > >
> > > > I think now is a good time to start thinking about a 1.5.1 release,
> for
> > > > which I would volunteer as the release manager.
> > > >
> > > > There are a few issues that I'm aware of that we should include in
> the
> > > > release [3], but I believe these should be resolved within the next
> > days.
> > > > So that we don't overlap with with proposed 1.6 release [2] we
> ideally
> > > > start the release process this week.
> > > >
> > > > What do you think?
> > > >
> > > > [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
> > > >
> > > > [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb
> > > > 722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
> > > >
> > > > [3]
> > > >
> > > > - https://issues.apache.org/jira/browse/FLINK-9280
> > > > - https://issues.apache.org/jira/browse/FLINK-8785
> > > > - https://issues.apache.org/jira/browse/FLINK-9567
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

回复:[DISCUSS] Release Flink 1.5.1

Zhijiang(wangzhijiang999)
In reply to this post by Chesnay Schepler-3
Hi Chesnay,

Agree with your proposal.  I submitted a jira FLINK-9676 related with deadlock issue.
I think it needs to be confirmed whether to be covered in this release or later.

Zhijiang
------------------------------------------------------------------
发件人:Chesnay Schepler <[hidden email]>
发送时间:2018年7月2日(星期一) 18:19
收件人:[hidden email] <[hidden email]>
主 题:[DISCUSS] Release Flink 1.5.1

Hello,

it has been a little over a month since we've release 1.5.0. Since then
we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
enhancement to the new execution mode (FLIP-6), fixes for critical
issues in the metric system, but also features that didn't quite make it
into 1.5.0 like FLIP-6 support for the scala-shell.

I think now is a good time to start thinking about a 1.5.1 release, for
which I would volunteer as the release manager.

There are a few issues that I'm aware of that we should include in the
release [3], but I believe these should be resolved within the next days.
So that we don't overlap with with proposed 1.6 release [2] we ideally
start the release process this week.

What do you think?

[1] https://issues.apache.org/jira/projects/FLINK/versions/12343053

[2]
https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E

[3]

- https://issues.apache.org/jira/browse/FLINK-9280
- https://issues.apache.org/jira/browse/FLINK-8785
- https://issues.apache.org/jira/browse/FLINK-9567

Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Jeff Zhang
Hi Chesnay,

I made FLINK-9554 <https://issues.apache.org/jira/browse/FLINK-9554> as
blocker of 1.5.1, as scala shell still doesn't work in yarn mode in the
latest master branch. (I believe it is the same in branch-1.5)



Zhijiang(wangzhijiang999) <[hidden email]>于2018年7月3日周二
下午12:04写道:

> Hi Chesnay,
>
> Agree with your proposal.  I submitted a jira FLINK-9676 related with
> deadlock issue.
> I think it needs to be confirmed whether to be covered in this release or
> later.
>
> Zhijiang
> ------------------------------------------------------------------
> 发件人:Chesnay Schepler <[hidden email]>
> 发送时间:2018年7月2日(星期一) 18:19
> 收件人:[hidden email] <[hidden email]>
> 主 题:[DISCUSS] Release Flink 1.5.1
>
> Hello,
>
> it has been a little over a month since we've release 1.5.0. Since then
> we've addressed 56 JIRAs [1] for the 1.5 branch, including stability
> enhancement to the new execution mode (FLIP-6), fixes for critical
> issues in the metric system, but also features that didn't quite make it
> into 1.5.0 like FLIP-6 support for the scala-shell.
>
> I think now is a good time to start thinking about a 1.5.1 release, for
> which I would volunteer as the release manager.
>
> There are a few issues that I'm aware of that we should include in the
> release [3], but I believe these should be resolved within the next days.
> So that we don't overlap with with proposed 1.6 release [2] we ideally
> start the release process this week.
>
> What do you think?
>
> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>
> [2]
>
> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>
> [3]
>
> - https://issues.apache.org/jira/browse/FLINK-9280
> - https://issues.apache.org/jira/browse/FLINK-8785
> - https://issues.apache.org/jira/browse/FLINK-9567
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Chesnay Schepler-3
In reply to this post by Chesnay Schepler-3
Alrighty, looks like we're in agreement for a soon release.

Let's take inventory of issues to still include:

- [FLINK-9554] flink scala shell doesn't work in yarn mode
I'm currently taking a look and will probably merge it by the end of today.

- [FLINK-9676] Deadlock during canceling task and recycling exclusive buffer
Till is taking a look to gauge how critical/fixable it is; we may not
fix it in this release.

- [FLINK-9707] LocalFileSystem does not support concurrent directory
creations
Till opened a PR that I'm reviewing at the moment.

- [FLINK-9693] Set Execution#taskRestore to null after deployment
Till opened a PR, i guess i can take a look unless anyone else wants to.

I will cut the release-branch this evening; this should be enough time
to fix the above issues. (except maybe FLINK-9676 of course)

On 02.07.2018 12:19, Chesnay Schepler wrote:

> Hello,
>
> it has been a little over a month since we've release 1.5.0. Since
> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
> stability enhancement to the new execution mode (FLIP-6), fixes for
> critical issues in the metric system, but also features that didn't
> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>
> I think now is a good time to start thinking about a 1.5.1 release,
> for which I would volunteer as the release manager.
>
> There are a few issues that I'm aware of that we should include in the
> release [3], but I believe these should be resolved within the next days.
> So that we don't overlap with with proposed 1.6 release [2] we ideally
> start the release process this week.
>
> What do you think?
>
> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>
> [2]
> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>
> [3]
>
> - https://issues.apache.org/jira/browse/FLINK-9280
> - https://issues.apache.org/jira/browse/FLINK-8785
> - https://issues.apache.org/jira/browse/FLINK-9567
>

Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Till Rohrmann
Quick update for FLINK-9676: It is not super critical/blocker to fix this
issue for Flink 1.5.1 since the deadlock only occurs in case of a task
cancellation and also then we haven't seen it to happen too often. If Flink
should deadlock, then there is still the TaskCancelerWatchDog which would
kill the TM process if the cancellation takes too long. Having said this,
it is still important to fix this issue but imo it is not a release blocker.

Nico is currently looking into it. Maybe we have a fix for it this evening
or it will be included in Flink 1.5.2.

Cheers,
Till

On Wed, Jul 4, 2018 at 11:21 AM Chesnay Schepler <[hidden email]> wrote:

> Alrighty, looks like we're in agreement for a soon release.
>
> Let's take inventory of issues to still include:
>
> - [FLINK-9554] flink scala shell doesn't work in yarn mode
> I'm currently taking a look and will probably merge it by the end of today.
>
> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
> buffer
> Till is taking a look to gauge how critical/fixable it is; we may not
> fix it in this release.
>
> - [FLINK-9707] LocalFileSystem does not support concurrent directory
> creations
> Till opened a PR that I'm reviewing at the moment.
>
> - [FLINK-9693] Set Execution#taskRestore to null after deployment
> Till opened a PR, i guess i can take a look unless anyone else wants to.
>
> I will cut the release-branch this evening; this should be enough time
> to fix the above issues. (except maybe FLINK-9676 of course)
>
> On 02.07.2018 12:19, Chesnay Schepler wrote:
> > Hello,
> >
> > it has been a little over a month since we've release 1.5.0. Since
> > then we've addressed 56 JIRAs [1] for the 1.5 branch, including
> > stability enhancement to the new execution mode (FLIP-6), fixes for
> > critical issues in the metric system, but also features that didn't
> > quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
> >
> > I think now is a good time to start thinking about a 1.5.1 release,
> > for which I would volunteer as the release manager.
> >
> > There are a few issues that I'm aware of that we should include in the
> > release [3], but I believe these should be resolved within the next days.
> > So that we don't overlap with with proposed 1.6 release [2] we ideally
> > start the release process this week.
> >
> > What do you think?
> >
> > [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
> >
> > [2]
> >
> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
> >
> > [3]
> >
> > - https://issues.apache.org/jira/browse/FLINK-9280
> > - https://issues.apache.org/jira/browse/FLINK-8785
> > - https://issues.apache.org/jira/browse/FLINK-9567
> >
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Release Flink 1.5.1

Chesnay Schepler-3
In reply to this post by Chesnay Schepler-3
Building the binary releases overnight failed due to a configuration
mistake on my side.

Till has informed me that FLINK-9676 might occur more often than we
initially suspected.
A PR to address the issue was already opened by Nico.
Given that I have to restart the process anyway today I'm delaying the
release for a few hours
so we have a chance to get the fix in.

On 04.07.2018 11:21, Chesnay Schepler wrote:

> Alrighty, looks like we're in agreement for a soon release.
>
> Let's take inventory of issues to still include:
>
> - [FLINK-9554] flink scala shell doesn't work in yarn mode
> I'm currently taking a look and will probably merge it by the end of
> today.
>
> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
> buffer
> Till is taking a look to gauge how critical/fixable it is; we may not
> fix it in this release.
>
> - [FLINK-9707] LocalFileSystem does not support concurrent directory
> creations
> Till opened a PR that I'm reviewing at the moment.
>
> - [FLINK-9693] Set Execution#taskRestore to null after deployment
> Till opened a PR, i guess i can take a look unless anyone else wants to.
>
> I will cut the release-branch this evening; this should be enough time
> to fix the above issues. (except maybe FLINK-9676 of course)
>
> On 02.07.2018 12:19, Chesnay Schepler wrote:
>> Hello,
>>
>> it has been a little over a month since we've release 1.5.0. Since
>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
>> stability enhancement to the new execution mode (FLIP-6), fixes for
>> critical issues in the metric system, but also features that didn't
>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>
>> I think now is a good time to start thinking about a 1.5.1 release,
>> for which I would volunteer as the release manager.
>>
>> There are a few issues that I'm aware of that we should include in
>> the release [3], but I believe these should be resolved within the
>> next days.
>> So that we don't overlap with with proposed 1.6 release [2] we
>> ideally start the release process this week.
>>
>> What do you think?
>>
>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>
>> [2]
>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>
>> [3]
>>
>> - https://issues.apache.org/jira/browse/FLINK-9280
>> - https://issues.apache.org/jira/browse/FLINK-8785
>> - https://issues.apache.org/jira/browse/FLINK-9567
>>
>
>

Reply | Threaded
Open this post in threaded view
|

回复:[DISCUSS] Release Flink 1.5.1

Zhijiang(wangzhijiang999)
I have reviewed FLINK-9676, wish it merged soon.

Zhijiang
------------------------------------------------------------------
发件人:Chesnay Schepler <[hidden email]>
发送时间:2018年7月5日(星期四) 15:58
收件人:[hidden email] <[hidden email]>; wangzhijiang999 <[hidden email]>; zjffdu <[hidden email]>; Till Rohrmann <[hidden email]>
主 题:Re: [DISCUSS] Release Flink 1.5.1

Building the binary releases overnight failed due to a configuration
mistake on my side.

Till has informed me that FLINK-9676 might occur more often than we
initially suspected.
A PR to address the issue was already opened by Nico.
Given that I have to restart the process anyway today I'm delaying the
release for a few hours
so we have a chance to get the fix in.

On 04.07.2018 11:21, Chesnay Schepler wrote:

> Alrighty, looks like we're in agreement for a soon release.
>
> Let's take inventory of issues to still include:
>
> - [FLINK-9554] flink scala shell doesn't work in yarn mode
> I'm currently taking a look and will probably merge it by the end of
> today.
>
> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
> buffer
> Till is taking a look to gauge how critical/fixable it is; we may not
> fix it in this release.
>
> - [FLINK-9707] LocalFileSystem does not support concurrent directory
> creations
> Till opened a PR that I'm reviewing at the moment.
>
> - [FLINK-9693] Set Execution#taskRestore to null after deployment
> Till opened a PR, i guess i can take a look unless anyone else wants to.
>
> I will cut the release-branch this evening; this should be enough time
> to fix the above issues. (except maybe FLINK-9676 of course)
>
> On 02.07.2018 12:19, Chesnay Schepler wrote:
>> Hello,
>>
>> it has been a little over a month since we've release 1.5.0. Since
>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
>> stability enhancement to the new execution mode (FLIP-6), fixes for
>> critical issues in the metric system, but also features that didn't
>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>
>> I think now is a good time to start thinking about a 1.5.1 release,
>> for which I would volunteer as the release manager.
>>
>> There are a few issues that I'm aware of that we should include in
>> the release [3], but I believe these should be resolved within the
>> next days.
>> So that we don't overlap with with proposed 1.6 release [2] we
>> ideally start the release process this week.
>>
>> What do you think?
>>
>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>
>> [2]
>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>
>> [3]
>>
>> - https://issues.apache.org/jira/browse/FLINK-9280
>> - https://issues.apache.org/jira/browse/FLINK-8785
>> - https://issues.apache.org/jira/browse/FLINK-9567
>>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: 回复:[DISCUSS] Release Flink 1.5.1

Nico Kruber
FYI: I just merged this to master as well as release-1.5 (hopefully -
this is my first merge since I became a committer)

On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:

> I have reviewed FLINK-9676, wish it merged soon.
>
> Zhijiang
> ------------------------------------------------------------------
> 发件人:Chesnay Schepler <[hidden email]>
> 发送时间:2018年7月5日(星期四) 15:58
> 收件人:[hidden email] <[hidden email]>; wangzhijiang999 <[hidden email]>; zjffdu <[hidden email]>; Till Rohrmann <[hidden email]>
> 主 题:Re: [DISCUSS] Release Flink 1.5.1
>
> Building the binary releases overnight failed due to a configuration
> mistake on my side.
>
> Till has informed me that FLINK-9676 might occur more often than we
> initially suspected.
> A PR to address the issue was already opened by Nico.
> Given that I have to restart the process anyway today I'm delaying the
> release for a few hours
> so we have a chance to get the fix in.
>
> On 04.07.2018 11:21, Chesnay Schepler wrote:
>> Alrighty, looks like we're in agreement for a soon release.
>>
>> Let's take inventory of issues to still include:
>>
>> - [FLINK-9554] flink scala shell doesn't work in yarn mode
>> I'm currently taking a look and will probably merge it by the end of
>> today.
>>
>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
>> buffer
>> Till is taking a look to gauge how critical/fixable it is; we may not
>> fix it in this release.
>>
>> - [FLINK-9707] LocalFileSystem does not support concurrent directory
>> creations
>> Till opened a PR that I'm reviewing at the moment.
>>
>> - [FLINK-9693] Set Execution#taskRestore to null after deployment
>> Till opened a PR, i guess i can take a look unless anyone else wants to.
>>
>> I will cut the release-branch this evening; this should be enough time
>> to fix the above issues. (except maybe FLINK-9676 of course)
>>
>> On 02.07.2018 12:19, Chesnay Schepler wrote:
>>> Hello,
>>>
>>> it has been a little over a month since we've release 1.5.0. Since
>>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
>>> stability enhancement to the new execution mode (FLIP-6), fixes for
>>> critical issues in the metric system, but also features that didn't
>>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>>
>>> I think now is a good time to start thinking about a 1.5.1 release,
>>> for which I would volunteer as the release manager.
>>>
>>> There are a few issues that I'm aware of that we should include in
>>> the release [3], but I believe these should be resolved within the
>>> next days.
>>> So that we don't overlap with with proposed 1.6 release [2] we
>>> ideally start the release process this week.
>>>
>>> What do you think?
>>>
>>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>>
>>> [2]
>>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>>
>>> [3]
>>>
>>> - https://issues.apache.org/jira/browse/FLINK-9280
>>> - https://issues.apache.org/jira/browse/FLINK-8785
>>> - https://issues.apache.org/jira/browse/FLINK-9567
>>>
>>
>>
>
--
Nico Kruber | Software Engineer
data Artisans

Follow us @dataArtisans
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany
data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA
--
Data Artisans GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen


signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: 回复:[DISCUSS] Release Flink 1.5.1

Chesnay Schepler-3
Alright then, I'll start building the artifacts.

On 05.07.2018 12:24, Nico Kruber wrote:

> FYI: I just merged this to master as well as release-1.5 (hopefully -
> this is my first merge since I became a committer)
>
> On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:
>> I have reviewed FLINK-9676, wish it merged soon.
>>
>> Zhijiang
>> ------------------------------------------------------------------
>> 发件人:Chesnay Schepler <[hidden email]>
>> 发送时间:2018年7月5日(星期四) 15:58
>> 收件人:[hidden email] <[hidden email]>; wangzhijiang999 <[hidden email]>; zjffdu <[hidden email]>; Till Rohrmann <[hidden email]>
>> 主 题:Re: [DISCUSS] Release Flink 1.5.1
>>
>> Building the binary releases overnight failed due to a configuration
>> mistake on my side.
>>
>> Till has informed me that FLINK-9676 might occur more often than we
>> initially suspected.
>> A PR to address the issue was already opened by Nico.
>> Given that I have to restart the process anyway today I'm delaying the
>> release for a few hours
>> so we have a chance to get the fix in.
>>
>> On 04.07.2018 11:21, Chesnay Schepler wrote:
>>> Alrighty, looks like we're in agreement for a soon release.
>>>
>>> Let's take inventory of issues to still include:
>>>
>>> - [FLINK-9554] flink scala shell doesn't work in yarn mode
>>> I'm currently taking a look and will probably merge it by the end of
>>> today.
>>>
>>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
>>> buffer
>>> Till is taking a look to gauge how critical/fixable it is; we may not
>>> fix it in this release.
>>>
>>> - [FLINK-9707] LocalFileSystem does not support concurrent directory
>>> creations
>>> Till opened a PR that I'm reviewing at the moment.
>>>
>>> - [FLINK-9693] Set Execution#taskRestore to null after deployment
>>> Till opened a PR, i guess i can take a look unless anyone else wants to.
>>>
>>> I will cut the release-branch this evening; this should be enough time
>>> to fix the above issues. (except maybe FLINK-9676 of course)
>>>
>>> On 02.07.2018 12:19, Chesnay Schepler wrote:
>>>> Hello,
>>>>
>>>> it has been a little over a month since we've release 1.5.0. Since
>>>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
>>>> stability enhancement to the new execution mode (FLIP-6), fixes for
>>>> critical issues in the metric system, but also features that didn't
>>>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>>>
>>>> I think now is a good time to start thinking about a 1.5.1 release,
>>>> for which I would volunteer as the release manager.
>>>>
>>>> There are a few issues that I'm aware of that we should include in
>>>> the release [3], but I believe these should be resolved within the
>>>> next days.
>>>> So that we don't overlap with with proposed 1.6 release [2] we
>>>> ideally start the release process this week.
>>>>
>>>> What do you think?
>>>>
>>>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>>>
>>>> [2]
>>>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>>>
>>>> [3]
>>>>
>>>> - https://issues.apache.org/jira/browse/FLINK-9280
>>>> - https://issues.apache.org/jira/browse/FLINK-8785
>>>> - https://issues.apache.org/jira/browse/FLINK-9567
>>>>
>>>

Reply | Threaded
Open this post in threaded view
|

Re: 回复:[DISCUSS] Release Flink 1.5.1

Nico Kruber
In reply to this post by Nico Kruber
I forgot to mention: there are some follow-ups on this but the gravity
is not as high as the deadlock of FLINK-9676 and PRs are not quite ready
yet ...

https://issues.apache.org/jira/browse/FLINK-9755
https://issues.apache.org/jira/browse/FLINK-9756
https://issues.apache.org/jira/browse/FLINK-9761


Nico

On 05/07/18 12:24, Nico Kruber wrote:

> FYI: I just merged this to master as well as release-1.5 (hopefully -
> this is my first merge since I became a committer)
>
> On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:
>> I have reviewed FLINK-9676, wish it merged soon.
>>
>> Zhijiang
>> ------------------------------------------------------------------
>> 发件人:Chesnay Schepler <[hidden email]>
>> 发送时间:2018年7月5日(星期四) 15:58
>> 收件人:[hidden email] <[hidden email]>; wangzhijiang999 <[hidden email]>; zjffdu <[hidden email]>; Till Rohrmann <[hidden email]>
>> 主 题:Re: [DISCUSS] Release Flink 1.5.1
>>
>> Building the binary releases overnight failed due to a configuration
>> mistake on my side.
>>
>> Till has informed me that FLINK-9676 might occur more often than we
>> initially suspected.
>> A PR to address the issue was already opened by Nico.
>> Given that I have to restart the process anyway today I'm delaying the
>> release for a few hours
>> so we have a chance to get the fix in.
>>
>> On 04.07.2018 11:21, Chesnay Schepler wrote:
>>> Alrighty, looks like we're in agreement for a soon release.
>>>
>>> Let's take inventory of issues to still include:
>>>
>>> - [FLINK-9554] flink scala shell doesn't work in yarn mode
>>> I'm currently taking a look and will probably merge it by the end of
>>> today.
>>>
>>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive
>>> buffer
>>> Till is taking a look to gauge how critical/fixable it is; we may not
>>> fix it in this release.
>>>
>>> - [FLINK-9707] LocalFileSystem does not support concurrent directory
>>> creations
>>> Till opened a PR that I'm reviewing at the moment.
>>>
>>> - [FLINK-9693] Set Execution#taskRestore to null after deployment
>>> Till opened a PR, i guess i can take a look unless anyone else wants to.
>>>
>>> I will cut the release-branch this evening; this should be enough time
>>> to fix the above issues. (except maybe FLINK-9676 of course)
>>>
>>> On 02.07.2018 12:19, Chesnay Schepler wrote:
>>>> Hello,
>>>>
>>>> it has been a little over a month since we've release 1.5.0. Since
>>>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including
>>>> stability enhancement to the new execution mode (FLIP-6), fixes for
>>>> critical issues in the metric system, but also features that didn't
>>>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>>>
>>>> I think now is a good time to start thinking about a 1.5.1 release,
>>>> for which I would volunteer as the release manager.
>>>>
>>>> There are a few issues that I'm aware of that we should include in
>>>> the release [3], but I believe these should be resolved within the
>>>> next days.
>>>> So that we don't overlap with with proposed 1.6 release [2] we
>>>> ideally start the release process this week.
>>>>
>>>> What do you think?
>>>>
>>>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>>>
>>>> [2]
>>>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>>>
>>>> [3]
>>>>
>>>> - https://issues.apache.org/jira/browse/FLINK-9280
>>>> - https://issues.apache.org/jira/browse/FLINK-8785
>>>> - https://issues.apache.org/jira/browse/FLINK-9567
>>>>
>>>
>>>
>>
>
--
Nico Kruber | Software Engineer
data Artisans

Follow us @dataArtisans
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany
data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA
--
Data Artisans GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen


signature.asc (201 bytes) Download Attachment