[ANNOUNCE] Weekly Community Update 2019/50

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[ANNOUNCE] Weekly Community Update 2019/50

Konstantin Knauf-3
Dear community,

happy to share this week's brief community digest with updates on Flink
1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive
setups, a couple of blog posts and a bit more.

*Personal Note:* Thank you for reading these updates since I started them
early this year. I will take a three week Christmas break and will be back
with a Holiday season community update on the 12th of January.

Flink Development
==============

* [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]

* [releases] The feature freeze for Apache Flink took place on Monday. The
community is now working on testing, bug fixes and improving the
documentation in order to create a first release candidate soon. [3]

* [development process] Seth has revived the discussion on a past PR by
Marta, which added a documentation style guide to the contributor guide.
Please check it [4] out, if you are contributing documentation to Apache
Flink. [5]

* [security] Following a recent report to the Flink PMC of "exploiting" the
Flink Web UI for remote code execution, Robert has started a discussion on
how to improve the tooling/documentation to make users aware of this
possibility and recommend securing this interface in production setups. [6]

* [sql] Bowen has started a discussion on how to simplify the Flink-Hive
setup for new users as currently users need to add some additional
dependencies to the classpath manually. The discussion seems to conclude
towards providing a single additional hive-uber jar, which contains all the
required dependencies. [7]

[1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html
[3]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html
[4] https://github.com/apache/flink-web/pull/240
[5]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html
[6]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html
[7]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html

Notable Bugs
==========

[FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all
tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]

[8] https://issues.apache.org/jira/browse/FLINK-15152

Events, Blog Posts, Misc
===================

* Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]

* Gerred Dillon has published a blog post on the Apache Flink blog on how
to run Flink on Kubernetes with a KUDO Flink operator. [10]

* In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and
motivation for his and his colleague's work to provide a world-class Python
support for Apache Flink's Table API. [11]

* Upcoming Meetups
    * On December 17th there will be the second Apache Flink meetup in
Seoul. [12] *Dongwon* has shared a detailed agenda in last weeks community
update. [13]
    * On December 18th Alexander Fedulov will talk about Stateful Stream
Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]

[9]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html
[10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html
[11]
https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/
[12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/
[13]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html
[14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

+49 160 91394525


Follow us @VervericaData Ververica <https://www.ververica.com/>


--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Weekly Community Update 2019/50

Hequn Cheng
Hi Konstantin,

Happy holidays and thanks a lot for your great job on the updates
continuously.
With the updates, it is easier for us to catch up with what's going on in
the community, which I think is quite helpful.

I'm wondering if I can do some help and cover this during your vocation. :)

Best,
Hequn

On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <[hidden email]>
wrote:

> Dear community,
>
> happy to share this week's brief community digest with updates on Flink
> 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive
> setups, a couple of blog posts and a bit more.
>
> *Personal Note:* Thank you for reading these updates since I started them
> early this year. I will take a three week Christmas break and will be back
> with a Holiday season community update on the 12th of January.
>
> Flink Development
> ==============
>
> * [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]
>
> * [releases] The feature freeze for Apache Flink took place on Monday. The
> community is now working on testing, bug fixes and improving the
> documentation in order to create a first release candidate soon. [3]
>
> * [development process] Seth has revived the discussion on a past PR by
> Marta, which added a documentation style guide to the contributor guide.
> Please check it [4] out, if you are contributing documentation to Apache
> Flink. [5]
>
> * [security] Following a recent report to the Flink PMC of "exploiting"
> the Flink Web UI for remote code execution, Robert has started a discussion
> on how to improve the tooling/documentation to make users aware of this
> possibility and recommend securing this interface in production setups. [6]
>
> * [sql] Bowen has started a discussion on how to simplify the Flink-Hive
> setup for new users as currently users need to add some additional
> dependencies to the classpath manually. The discussion seems to conclude
> towards providing a single additional hive-uber jar, which contains all the
> required dependencies. [7]
>
> [1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html
> [2]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html
> [3]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html
> [4] https://github.com/apache/flink-web/pull/240
> [5]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html
> [6]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html
> [7]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html
>
> Notable Bugs
> ==========
>
> [FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all
> tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]
>
> [8] https://issues.apache.org/jira/browse/FLINK-15152
>
> Events, Blog Posts, Misc
> ===================
>
> * Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]
>
> * Gerred Dillon has published a blog post on the Apache Flink blog on how
> to run Flink on Kubernetes with a KUDO Flink operator. [10]
>
> * In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and
> motivation for his and his colleague's work to provide a world-class Python
> support for Apache Flink's Table API. [11]
>
> * Upcoming Meetups
>     * On December 17th there will be the second Apache Flink meetup in
> Seoul. [12] *Dongwon* has shared a detailed agenda in last weeks
> community update. [13]
>     * On December 18th Alexander Fedulov will talk about Stateful Stream
> Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]
>
> [9]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html
> [10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html
> [11]
> https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/
> [12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/
> [13]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html
> [14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/
>
> Cheers,
>
> Konstantin (@snntrable)
>
> --
>
> Konstantin Knauf | Solutions Architect
>
> +49 160 91394525
>
>
> Follow us @VervericaData Ververica <https://www.ververica.com/>
>
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
> --
>
> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>
> --
> Ververica GmbH
> Registered at Amtsgericht Charlottenburg: HRB 158244 B
> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
> (Tony) Cheng
>
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Weekly Community Update 2019/50

Konstantin Knauf-3
Hi Hequn,

thanks, and thanks for the offer. Of course, you can cover the holiday
break, i.e. the next three weeks. Looking forward to your updates!

Cheers,

Konstantin

On Mon, Dec 16, 2019 at 5:53 AM Hequn Cheng <[hidden email]> wrote:

> Hi Konstantin,
>
> Happy holidays and thanks a lot for your great job on the updates
> continuously.
> With the updates, it is easier for us to catch up with what's going on in
> the community, which I think is quite helpful.
>
> I'm wondering if I can do some help and cover this during your vocation. :)
>
> Best,
> Hequn
>
> On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <
> [hidden email]> wrote:
>
>> Dear community,
>>
>> happy to share this week's brief community digest with updates on Flink
>> 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive
>> setups, a couple of blog posts and a bit more.
>>
>> *Personal Note:* Thank you for reading these updates since I started
>> them early this year. I will take a three week Christmas break and will be
>> back with a Holiday season community update on the 12th of January.
>>
>> Flink Development
>> ==============
>>
>> * [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]
>>
>> * [releases] The feature freeze for Apache Flink took place on Monday.
>> The community is now working on testing, bug fixes and improving the
>> documentation in order to create a first release candidate soon. [3]
>>
>> * [development process] Seth has revived the discussion on a past PR by
>> Marta, which added a documentation style guide to the contributor guide.
>> Please check it [4] out, if you are contributing documentation to Apache
>> Flink. [5]
>>
>> * [security] Following a recent report to the Flink PMC of "exploiting"
>> the Flink Web UI for remote code execution, Robert has started a discussion
>> on how to improve the tooling/documentation to make users aware of this
>> possibility and recommend securing this interface in production setups. [6]
>>
>> * [sql] Bowen has started a discussion on how to simplify the Flink-Hive
>> setup for new users as currently users need to add some additional
>> dependencies to the classpath manually. The discussion seems to conclude
>> towards providing a single additional hive-uber jar, which contains all the
>> required dependencies. [7]
>>
>> [1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html
>> [2]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html
>> [3]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html
>> [4] https://github.com/apache/flink-web/pull/240
>> [5]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html
>> [6]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html
>> [7]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html
>>
>> Notable Bugs
>> ==========
>>
>> [FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not
>> all tasks are in "RUNNING" state the job is not checkpointing afterwards.
>> [8]
>>
>> [8] https://issues.apache.org/jira/browse/FLINK-15152
>>
>> Events, Blog Posts, Misc
>> ===================
>>
>> * Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]
>>
>> * Gerred Dillon has published a blog post on the Apache Flink blog on how
>> to run Flink on Kubernetes with a KUDO Flink operator. [10]
>>
>> * In this blog post Apache Flink PMC Sun Jincheng outlines the reasons
>> and motivation for his and his colleague's work to provide a world-class
>> Python support for Apache Flink's Table API. [11]
>>
>> * Upcoming Meetups
>>     * On December 17th there will be the second Apache Flink meetup in
>> Seoul. [12] *Dongwon* has shared a detailed agenda in last weeks
>> community update. [13]
>>     * On December 18th Alexander Fedulov will talk about Stateful Stream
>> Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]
>>
>> [9]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html
>> [10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html
>> [11]
>> https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/
>> [12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/
>> [13]
>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html
>> [14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/
>>
>> Cheers,
>>
>> Konstantin (@snntrable)
>>
>> --
>>
>> Konstantin Knauf | Solutions Architect
>>
>> +49 160 91394525
>>
>>
>> Follow us @VervericaData Ververica <https://www.ververica.com/>
>>
>>
>> --
>>
>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>> Conference
>>
>> Stream Processing | Event Driven | Real Time
>>
>> --
>>
>> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>>
>> --
>> Ververica GmbH
>> Registered at Amtsgericht Charlottenburg: HRB 158244 B
>> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
>> (Tony) Cheng
>>
>

--

Konstantin Knauf | Solutions Architect

+49 160 91394525


Follow us @VervericaData Ververica <https://www.ververica.com/>


--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Weekly Community Update 2019/50

Hequn Cheng
Cool. I will do it in the next three weeks.
Thanks a lot for your continued great work!

Best, Hequn

On Tue, Dec 17, 2019 at 6:16 PM Konstantin Knauf <[hidden email]>
wrote:

> Hi Hequn,
>
> thanks, and thanks for the offer. Of course, you can cover the holiday
> break, i.e. the next three weeks. Looking forward to your updates!
>
> Cheers,
>
> Konstantin
>
> On Mon, Dec 16, 2019 at 5:53 AM Hequn Cheng <[hidden email]> wrote:
>
>> Hi Konstantin,
>>
>> Happy holidays and thanks a lot for your great job on the updates
>> continuously.
>> With the updates, it is easier for us to catch up with what's going on in
>> the community, which I think is quite helpful.
>>
>> I'm wondering if I can do some help and cover this during your vocation.
>> :)
>>
>> Best,
>> Hequn
>>
>> On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <
>> [hidden email]> wrote:
>>
>>> Dear community,
>>>
>>> happy to share this week's brief community digest with updates on Flink
>>> 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive
>>> setups, a couple of blog posts and a bit more.
>>>
>>> *Personal Note:* Thank you for reading these updates since I started
>>> them early this year. I will take a three week Christmas break and will be
>>> back with a Holiday season community update on the 12th of January.
>>>
>>> Flink Development
>>> ==============
>>>
>>> * [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]
>>>
>>> * [releases] The feature freeze for Apache Flink took place on Monday.
>>> The community is now working on testing, bug fixes and improving the
>>> documentation in order to create a first release candidate soon. [3]
>>>
>>> * [development process] Seth has revived the discussion on a past PR by
>>> Marta, which added a documentation style guide to the contributor guide.
>>> Please check it [4] out, if you are contributing documentation to Apache
>>> Flink. [5]
>>>
>>> * [security] Following a recent report to the Flink PMC of "exploiting"
>>> the Flink Web UI for remote code execution, Robert has started a discussion
>>> on how to improve the tooling/documentation to make users aware of this
>>> possibility and recommend securing this interface in production setups. [6]
>>>
>>> * [sql] Bowen has started a discussion on how to simplify the Flink-Hive
>>> setup for new users as currently users need to add some additional
>>> dependencies to the classpath manually. The discussion seems to conclude
>>> towards providing a single additional hive-uber jar, which contains all the
>>> required dependencies. [7]
>>>
>>> [1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html
>>> [2]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html
>>> [3]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html
>>> [4] https://github.com/apache/flink-web/pull/240
>>> [5]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html
>>> [6]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html
>>> [7]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html
>>>
>>> Notable Bugs
>>> ==========
>>>
>>> [FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not
>>> all tasks are in "RUNNING" state the job is not checkpointing afterwards.
>>> [8]
>>>
>>> [8] https://issues.apache.org/jira/browse/FLINK-15152
>>>
>>> Events, Blog Posts, Misc
>>> ===================
>>>
>>> * Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]
>>>
>>> * Gerred Dillon has published a blog post on the Apache Flink blog on
>>> how to run Flink on Kubernetes with a KUDO Flink operator. [10]
>>>
>>> * In this blog post Apache Flink PMC Sun Jincheng outlines the reasons
>>> and motivation for his and his colleague's work to provide a world-class
>>> Python support for Apache Flink's Table API. [11]
>>>
>>> * Upcoming Meetups
>>>     * On December 17th there will be the second Apache Flink meetup in
>>> Seoul. [12] *Dongwon* has shared a detailed agenda in last weeks
>>> community update. [13]
>>>     * On December 18th Alexander Fedulov will talk about Stateful Stream
>>> Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]
>>>
>>> [9]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html
>>> [10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html
>>> [11]
>>> https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/
>>> [12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/
>>> [13]
>>> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html
>>> [14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/
>>>
>>> Cheers,
>>>
>>> Konstantin (@snntrable)
>>>
>>> --
>>>
>>> Konstantin Knauf | Solutions Architect
>>>
>>> +49 160 91394525
>>>
>>>
>>> Follow us @VervericaData Ververica <https://www.ververica.com/>
>>>
>>>
>>> --
>>>
>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>> Conference
>>>
>>> Stream Processing | Event Driven | Real Time
>>>
>>> --
>>>
>>> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>>>
>>> --
>>> Ververica GmbH
>>> Registered at Amtsgericht Charlottenburg: HRB 158244 B
>>> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
>>> (Tony) Cheng
>>>
>>
>
> --
>
> Konstantin Knauf | Solutions Architect
>
> +49 160 91394525
>
>
> Follow us @VervericaData Ververica <https://www.ververica.com/>
>
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
> --
>
> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>
> --
> Ververica GmbH
> Registered at Amtsgericht Charlottenburg: HRB 158244 B
> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
> (Tony) Cheng
>