[DISCUSS] Backport FLINK-13326 to 1.9 release

[Stephan Ewen]

Hi all!

I would like to backport a minor chance from 'master' to 'release-1.9'.
It is a very minor change

I am checking here because this is not technically a bug fix, but a way of
exposing the raw keyed state stream in tasks a bit different. It would
unblock some work in a project that tries to fix the fault tolerance of
streaming iterations.

Any concerns?

Best,
Stephan

[Ufuk Celebi-2]

Thanks for checking. No concerns on my side. +1 to back port. Fixing fault
tolerance of streaming iterations sounds like a very valuable thing to
unblock with this release.

– Ufuk


On Thu, Aug 1, 2019 at 11:02 AM Stephan Ewen <[hidden email]> wrote:

> Hi all!
>
> I would like to backport a minor chance from 'master' to 'release-1.9'.
> It is a very minor change
>
> I am checking here because this is not technically a bug fix, but a way of
> exposing the raw keyed state stream in tasks a bit different. It would
> unblock some work in a project that tries to fix the fault tolerance of
> streaming iterations.
>
> Any concerns?
>
> Best,
> Stephan
>

[Till Rohrmann]

I've quickly glanced over the changes and I would be ok with backporting it
if it helps fixing fault tolerance of streaming iterations. Hence +1 from
my side.

Cheers,
Till

On Thu, Aug 1, 2019 at 11:20 AM Ufuk Celebi <[hidden email]> wrote:

> Thanks for checking. No concerns on my side. +1 to back port. Fixing fault
> tolerance of streaming iterations sounds like a very valuable thing to
> unblock with this release.
>
> – Ufuk
>
>
> On Thu, Aug 1, 2019 at 11:02 AM Stephan Ewen <[hidden email]> wrote:
>
> > Hi all!
> >
> > I would like to backport a minor chance from 'master' to 'release-1.9'.
> > It is a very minor change
> >
> > I am checking here because this is not technically a bug fix, but a way
> of
> > exposing the raw keyed state stream in tasks a bit different. It would
> > unblock some work in a project that tries to fix the fault tolerance of
> > streaming iterations.
> >
> > Any concerns?
> >
> > Best,
> > Stephan
> >
>

[Becket Qin]

+1 as well. If this affects the fault tolerance of streaming iteration, I'd
consider this as a bug fix.

On Thu, Aug 1, 2019 at 11:44 AM Till Rohrmann <[hidden email]> wrote:

> I've quickly glanced over the changes and I would be ok with backporting it
> if it helps fixing fault tolerance of streaming iterations. Hence +1 from
> my side.
>
> Cheers,
> Till
>
> On Thu, Aug 1, 2019 at 11:20 AM Ufuk Celebi <[hidden email]> wrote:
>
> > Thanks for checking. No concerns on my side. +1 to back port. Fixing
> fault
> > tolerance of streaming iterations sounds like a very valuable thing to
> > unblock with this release.
> >
> > – Ufuk
> >
> >
> > On Thu, Aug 1, 2019 at 11:02 AM Stephan Ewen <[hidden email]> wrote:
> >
> > > Hi all!
> > >
> > > I would like to backport a minor chance from 'master' to 'release-1.9'.
> > > It is a very minor change
> > >
> > > I am checking here because this is not technically a bug fix, but a way
> > of
> > > exposing the raw keyed state stream in tasks a bit different. It would
> > > unblock some work in a project that tries to fix the fault tolerance of
> > > streaming iterations.
> > >
> > > Any concerns?
> > >
> > > Best,
> > > Stephan
> > >
> >
>

[Stephan Ewen]

For clarification: It does not fix the loop fault tolerance in the existing
API. There, the concepts are a bit messy and this needs a bigger overhaul.

It is a building block for building fault tolerant loops in downstream
projects.

On Thu, Aug 1, 2019 at 11:45 AM Becket Qin <[hidden email]> wrote:

> +1 as well. If this affects the fault tolerance of streaming iteration, I'd
> consider this as a bug fix.
>
> On Thu, Aug 1, 2019 at 11:44 AM Till Rohrmann <[hidden email]>
> wrote:
>
> > I've quickly glanced over the changes and I would be ok with backporting
> it
> > if it helps fixing fault tolerance of streaming iterations. Hence +1 from
> > my side.
> >
> > Cheers,
> > Till
> >
> > On Thu, Aug 1, 2019 at 11:20 AM Ufuk Celebi <[hidden email]> wrote:
> >
> > > Thanks for checking. No concerns on my side. +1 to back port. Fixing
> > fault
> > > tolerance of streaming iterations sounds like a very valuable thing to
> > > unblock with this release.
> > >
> > > – Ufuk
> > >
> > >
> > > On Thu, Aug 1, 2019 at 11:02 AM Stephan Ewen <[hidden email]> wrote:
> > >
> > > > Hi all!
> > > >
> > > > I would like to backport a minor chance from 'master' to
> 'release-1.9'.
> > > > It is a very minor change
> > > >
> > > > I am checking here because this is not technically a bug fix, but a
> way
> > > of
> > > > exposing the raw keyed state stream in tasks a bit different. It
> would
> > > > unblock some work in a project that tries to fix the fault tolerance
> of
> > > > streaming iterations.
> > > >
> > > > Any concerns?
> > > >
> > > > Best,
> > > > Stephan
> > > >
> > >
> >
>