Some notes from the first Flink Hangout

[Kostas Tzoumas]

Hi everyone,

I tried to record the first hangout on youtube but we had several problems
with sound and video. Below are some rough notes.

If you participated in the meeting, please feel free to add notes

Kostas

Website:
--------

- Documentation contains lots of broken links

- Frontpage - remove Metor, color-coding of the stack, and features
  (do not include features)


Streaming:
----------

- Low-latency streaming functionality and API

- Move to the main repository
  - Down the road be able to mix APIs
  - Dependencies on current runtime refactoring

- Add committers


Intermediate datasets:
----------------------

- Switch to more pull-based mode with intermediate datasets as
  first-class citizens

- Currently working on how to support pipelined channels with that


Tez:
----

- Replace code paths of Flink with Tez

- Open questions related to incremental rollout and streaming


Hadoop Compatibility:
---------------------

- Report on progress by Artem


Renaming:
---------

- Possibility to start renaming of packages without legal approval

- Will rename some parts of Java API

[Márton Balassi]

Thanks for the write-up, I do agree with the streaming notes.

Cheers,

Marton


On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <[hidden email]>
wrote:

> Hi everyone,
>
> I tried to record the first hangout on youtube but we had several problems
> with sound and video. Below are some rough notes.
>
> If you participated in the meeting, please feel free to add notes
>
> Kostas
>
> Website:
> --------
>
> - Documentation contains lots of broken links
>
> - Frontpage - remove Metor, color-coding of the stack, and features
>   (do not include features)
>
>
> Streaming:
> ----------
>
> - Low-latency streaming functionality and API
>
> - Move to the main repository
>   - Down the road be able to mix APIs
>   - Dependencies on current runtime refactoring
>
> - Add committers
>
>
> Intermediate datasets:
> ----------------------
>
> - Switch to more pull-based mode with intermediate datasets as
>   first-class citizens
>
> - Currently working on how to support pipelined channels with that
>
>
> Tez:
> ----
>
> - Replace code paths of Flink with Tez
>
> - Open questions related to incremental rollout and streaming
>
>
> Hadoop Compatibility:
> ---------------------
>
> - Report on progress by Artem
>
>
> Renaming:
> ---------
>
> - Possibility to start renaming of packages without legal approval
>
> - Will rename some parts of Java API
>

[Robert Metzger]

If we stick to our decision to do a bi-weekly hangout, the next one would
be this Wednesday.
Are we going again for 9am PST / 6pm CET ?

Robert


On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <[hidden email]>
wrote:

> Thanks for the write-up, I do agree with the streaming notes.
>
> Cheers,
>
> Marton
>
>
> On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> [hidden email]>
> wrote:
>
> > Hi everyone,
> >
> > I tried to record the first hangout on youtube but we had several
> problems
> > with sound and video. Below are some rough notes.
> >
> > If you participated in the meeting, please feel free to add notes
> >
> > Kostas
> >
> > Website:
> > --------
> >
> > - Documentation contains lots of broken links
> >
> > - Frontpage - remove Metor, color-coding of the stack, and features
> >   (do not include features)
> >
> >
> > Streaming:
> > ----------
> >
> > - Low-latency streaming functionality and API
> >
> > - Move to the main repository
> >   - Down the road be able to mix APIs
> >   - Dependencies on current runtime refactoring
> >
> > - Add committers
> >
> >
> > Intermediate datasets:
> > ----------------------
> >
> > - Switch to more pull-based mode with intermediate datasets as
> >   first-class citizens
> >
> > - Currently working on how to support pipelined channels with that
> >
> >
> > Tez:
> > ----
> >
> > - Replace code paths of Flink with Tez
> >
> > - Open questions related to incremental rollout and streaming
> >
> >
> > Hadoop Compatibility:
> > ---------------------
> >
> > - Report on progress by Artem
> >
> >
> > Renaming:
> > ---------
> >
> > - Possibility to start renaming of packages without legal approval
> >
> > - Will rename some parts of Java API
> >
>

[Kostas Tzoumas]

+1


On Mon, Jul 14, 2014 at 3:27 PM, Robert Metzger <[hidden email]> wrote:

> If we stick to our decision to do a bi-weekly hangout, the next one would
> be this Wednesday.
> Are we going again for 9am PST / 6pm CET ?
>
> Robert
>
>
> On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <[hidden email]>
> wrote:
>
> > Thanks for the write-up, I do agree with the streaming notes.
> >
> > Cheers,
> >
> > Marton
> >
> >
> > On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> > [hidden email]>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I tried to record the first hangout on youtube but we had several
> > problems
> > > with sound and video. Below are some rough notes.
> > >
> > > If you participated in the meeting, please feel free to add notes
> > >
> > > Kostas
> > >
> > > Website:
> > > --------
> > >
> > > - Documentation contains lots of broken links
> > >
> > > - Frontpage - remove Metor, color-coding of the stack, and features
> > >   (do not include features)
> > >
> > >
> > > Streaming:
> > > ----------
> > >
> > > - Low-latency streaming functionality and API
> > >
> > > - Move to the main repository
> > >   - Down the road be able to mix APIs
> > >   - Dependencies on current runtime refactoring
> > >
> > > - Add committers
> > >
> > >
> > > Intermediate datasets:
> > > ----------------------
> > >
> > > - Switch to more pull-based mode with intermediate datasets as
> > >   first-class citizens
> > >
> > > - Currently working on how to support pipelined channels with that
> > >
> > >
> > > Tez:
> > > ----
> > >
> > > - Replace code paths of Flink with Tez
> > >
> > > - Open questions related to incremental rollout and streaming
> > >
> > >
> > > Hadoop Compatibility:
> > > ---------------------
> > >
> > > - Report on progress by Artem
> > >
> > >
> > > Renaming:
> > > ---------
> > >
> > > - Possibility to start renaming of packages without legal approval
> > >
> > > - Will rename some parts of Java API
> > >
> >
>

[Henry Saputra]

+1

How was it done last time to get the hangout invite?

On Monday, July 14, 2014, Robert Metzger <[hidden email]> wrote:

> If we stick to our decision to do a bi-weekly hangout, the next one would
> be this Wednesday.
> Are we going again for 9am PST / 6pm CET ?
>
> Robert
>
>
> On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <[hidden email]
> <javascript:;>>
> wrote:
>
> > Thanks for the write-up, I do agree with the streaming notes.
> >
> > Cheers,
> >
> > Marton
> >
> >
> > On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> > [hidden email] <javascript:;>>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I tried to record the first hangout on youtube but we had several
> > problems
> > > with sound and video. Below are some rough notes.
> > >
> > > If you participated in the meeting, please feel free to add notes
> > >
> > > Kostas
> > >
> > > Website:
> > > --------
> > >
> > > - Documentation contains lots of broken links
> > >
> > > - Frontpage - remove Metor, color-coding of the stack, and features
> > >   (do not include features)
> > >
> > >
> > > Streaming:
> > > ----------
> > >
> > > - Low-latency streaming functionality and API
> > >
> > > - Move to the main repository
> > >   - Down the road be able to mix APIs
> > >   - Dependencies on current runtime refactoring
> > >
> > > - Add committers
> > >
> > >
> > > Intermediate datasets:
> > > ----------------------
> > >
> > > - Switch to more pull-based mode with intermediate datasets as
> > >   first-class citizens
> > >
> > > - Currently working on how to support pipelined channels with that
> > >
> > >
> > > Tez:
> > > ----
> > >
> > > - Replace code paths of Flink with Tez
> > >
> > > - Open questions related to incremental rollout and streaming
> > >
> > >
> > > Hadoop Compatibility:
> > > ---------------------
> > >
> > > - Report on progress by Artem
> > >
> > >
> > > Renaming:
> > > ---------
> > >
> > > - Possibility to start renaming of packages without legal approval
> > >
> > > - Will rename some parts of Java API
> > >
> >
>

[Kostas Tzoumas]

We shared the link to the hangout in this conversation thread.

We should create a youtube channel for Flink (last time I used my personal
one) and record it there tomorrow.

Kostas


On Mon, Jul 14, 2014 at 6:38 PM, Henry Saputra <[hidden email]>
wrote:

> +1
>
> How was it done last time to get the hangout invite?
>
> On Monday, July 14, 2014, Robert Metzger <[hidden email]> wrote:
>
> > If we stick to our decision to do a bi-weekly hangout, the next one would
> > be this Wednesday.
> > Are we going again for 9am PST / 6pm CET ?
> >
> > Robert
> >
> >
> > On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <[hidden email]
> > <javascript:;>>
> > wrote:
> >
> > > Thanks for the write-up, I do agree with the streaming notes.
> > >
> > > Cheers,
> > >
> > > Marton
> > >
> > >
> > > On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> > > [hidden email] <javascript:;>>
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I tried to record the first hangout on youtube but we had several
> > > problems
> > > > with sound and video. Below are some rough notes.
> > > >
> > > > If you participated in the meeting, please feel free to add notes
> > > >
> > > > Kostas
> > > >
> > > > Website:
> > > > --------
> > > >
> > > > - Documentation contains lots of broken links
> > > >
> > > > - Frontpage - remove Metor, color-coding of the stack, and features
> > > >   (do not include features)
> > > >
> > > >
> > > > Streaming:
> > > > ----------
> > > >
> > > > - Low-latency streaming functionality and API
> > > >
> > > > - Move to the main repository
> > > >   - Down the road be able to mix APIs
> > > >   - Dependencies on current runtime refactoring
> > > >
> > > > - Add committers
> > > >
> > > >
> > > > Intermediate datasets:
> > > > ----------------------
> > > >
> > > > - Switch to more pull-based mode with intermediate datasets as
> > > >   first-class citizens
> > > >
> > > > - Currently working on how to support pipelined channels with that
> > > >
> > > >
> > > > Tez:
> > > > ----
> > > >
> > > > - Replace code paths of Flink with Tez
> > > >
> > > > - Open questions related to incremental rollout and streaming
> > > >
> > > >
> > > > Hadoop Compatibility:
> > > > ---------------------
> > > >
> > > > - Report on progress by Artem
> > > >
> > > >
> > > > Renaming:
> > > > ---------
> > > >
> > > > - Possibility to start renaming of packages without legal approval
> > > >
> > > > - Will rename some parts of Java API
> > > >
> > >
> >
>

[Robert Metzger]

I can not join the Hangout at 6pm CEST, sorry. I'm joining it next time.


On Tue, Jul 15, 2014 at 9:45 AM, Kostas Tzoumas <[hidden email]
> wrote:

> We shared the link to the hangout in this conversation thread.
>
> We should create a youtube channel for Flink (last time I used my personal
> one) and record it there tomorrow.
>
> Kostas
>
>
> On Mon, Jul 14, 2014 at 6:38 PM, Henry Saputra <[hidden email]>
> wrote:
>
> > +1
> >
> > How was it done last time to get the hangout invite?
> >
> > On Monday, July 14, 2014, Robert Metzger <[hidden email]> wrote:
> >
> > > If we stick to our decision to do a bi-weekly hangout, the next one
> would
> > > be this Wednesday.
> > > Are we going again for 9am PST / 6pm CET ?
> > >
> > > Robert
> > >
> > >
> > > On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <
> [hidden email]
> > > <javascript:;>>
> > > wrote:
> > >
> > > > Thanks for the write-up, I do agree with the streaming notes.
> > > >
> > > > Cheers,
> > > >
> > > > Marton
> > > >
> > > >
> > > > On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> > > > [hidden email] <javascript:;>>
> > > > wrote:
> > > >
> > > > > Hi everyone,
> > > > >
> > > > > I tried to record the first hangout on youtube but we had several
> > > > problems
> > > > > with sound and video. Below are some rough notes.
> > > > >
> > > > > If you participated in the meeting, please feel free to add notes
> > > > >
> > > > > Kostas
> > > > >
> > > > > Website:
> > > > > --------
> > > > >
> > > > > - Documentation contains lots of broken links
> > > > >
> > > > > - Frontpage - remove Metor, color-coding of the stack, and features
> > > > >   (do not include features)
> > > > >
> > > > >
> > > > > Streaming:
> > > > > ----------
> > > > >
> > > > > - Low-latency streaming functionality and API
> > > > >
> > > > > - Move to the main repository
> > > > >   - Down the road be able to mix APIs
> > > > >   - Dependencies on current runtime refactoring
> > > > >
> > > > > - Add committers
> > > > >
> > > > >
> > > > > Intermediate datasets:
> > > > > ----------------------
> > > > >
> > > > > - Switch to more pull-based mode with intermediate datasets as
> > > > >   first-class citizens
> > > > >
> > > > > - Currently working on how to support pipelined channels with that
> > > > >
> > > > >
> > > > > Tez:
> > > > > ----
> > > > >
> > > > > - Replace code paths of Flink with Tez
> > > > >
> > > > > - Open questions related to incremental rollout and streaming
> > > > >
> > > > >
> > > > > Hadoop Compatibility:
> > > > > ---------------------
> > > > >
> > > > > - Report on progress by Artem
> > > > >
> > > > >
> > > > > Renaming:
> > > > > ---------
> > > > >
> > > > > - Possibility to start renaming of packages without legal approval
> > > > >
> > > > > - Will rename some parts of Java API
> > > > >
> > > >
> > >
> >
>

[Kostas Tzoumas]

Hiya folks,

Join here: https://plus.google.com/hangouts/_/gxnzzp2egkjxq7swbyah5hjyema

Kostas


On Wed, Jul 16, 2014 at 4:03 PM, Robert Metzger <[hidden email]> wrote:

> I can not join the Hangout at 6pm CEST, sorry. I'm joining it next time.
>
>
> On Tue, Jul 15, 2014 at 9:45 AM, Kostas Tzoumas <
> [hidden email]
> > wrote:
>
> > We shared the link to the hangout in this conversation thread.
> >
> > We should create a youtube channel for Flink (last time I used my
> personal
> > one) and record it there tomorrow.
> >
> > Kostas
> >
> >
> > On Mon, Jul 14, 2014 at 6:38 PM, Henry Saputra <[hidden email]>
> > wrote:
> >
> > > +1
> > >
> > > How was it done last time to get the hangout invite?
> > >
> > > On Monday, July 14, 2014, Robert Metzger <[hidden email]> wrote:
> > >
> > > > If we stick to our decision to do a bi-weekly hangout, the next one
> > would
> > > > be this Wednesday.
> > > > Are we going again for 9am PST / 6pm CET ?
> > > >
> > > > Robert
> > > >
> > > >
> > > > On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi <
> > [hidden email]
> > > > <javascript:;>>
> > > > wrote:
> > > >
> > > > > Thanks for the write-up, I do agree with the streaming notes.
> > > > >
> > > > > Cheers,
> > > > >
> > > > > Marton
> > > > >
> > > > >
> > > > > On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas <
> > > > > [hidden email] <javascript:;>>
> > > > > wrote:
> > > > >
> > > > > > Hi everyone,
> > > > > >
> > > > > > I tried to record the first hangout on youtube but we had several
> > > > > problems
> > > > > > with sound and video. Below are some rough notes.
> > > > > >
> > > > > > If you participated in the meeting, please feel free to add notes
> > > > > >
> > > > > > Kostas
> > > > > >
> > > > > > Website:
> > > > > > --------
> > > > > >
> > > > > > - Documentation contains lots of broken links
> > > > > >
> > > > > > - Frontpage - remove Metor, color-coding of the stack, and
> features
> > > > > >   (do not include features)
> > > > > >
> > > > > >
> > > > > > Streaming:
> > > > > > ----------
> > > > > >
> > > > > > - Low-latency streaming functionality and API
> > > > > >
> > > > > > - Move to the main repository
> > > > > >   - Down the road be able to mix APIs
> > > > > >   - Dependencies on current runtime refactoring
> > > > > >
> > > > > > - Add committers
> > > > > >
> > > > > >
> > > > > > Intermediate datasets:
> > > > > > ----------------------
> > > > > >
> > > > > > - Switch to more pull-based mode with intermediate datasets as
> > > > > >   first-class citizens
> > > > > >
> > > > > > - Currently working on how to support pipelined channels with
> that
> > > > > >
> > > > > >
> > > > > > Tez:
> > > > > > ----
> > > > > >
> > > > > > - Replace code paths of Flink with Tez
> > > > > >
> > > > > > - Open questions related to incremental rollout and streaming
> > > > > >
> > > > > >
> > > > > > Hadoop Compatibility:
> > > > > > ---------------------
> > > > > >
> > > > > > - Report on progress by Artem
> > > > > >
> > > > > >
> > > > > > Renaming:
> > > > > > ---------
> > > > > >
> > > > > > - Possibility to start renaming of packages without legal
> approval
> > > > > >
> > > > > > - Will rename some parts of Java API
> > > > > >
> > > > >
> > > >
> > >
> >
>