[ANNOUNCE] Weekly Community Update 2019/37

[Konstantin Knauf-3]

Dear community,

happy to share this week's community update with the release of Flink
1.8.2, more work in the area of dynamic resource management, three
proposals in the SQL space and a bit more.

Flink Development
==============

* [releases] *Flink 1.8.2* has been released. [1]

* [resource management] Xintong has started a discussion on FLIP-56 "*Dynamic
Slot Allocation*". With upcoming FLIP-53 [2] different Tasks can have
different resource requirements leading to different resources requirements
for the TaskSlots these Tasks are deployed into. On the other hand,
TaskSlots are currently statically configured during TaskManager creation.
FLIP-56 proposes to start TaskManagers without any TaskSlots initially and
to dynamically create/release TaskSlots based on the resource requirements
of the Tasks to be deployed. [3]

* [connectors] Stephan has started a discussion to drop the Kafka connector
for *Kafka 0.9* and *0.10.* If you are relying on these connectors, it's a
good idea to join the discussion. [4]

* [connectors] The discussion on contributing a *Pulsar connector to Flink*
seems to be converging towards adding the connector soon based on the
existing source interface, but clearly documenting (experimental?) that in
the long-term only a version based on the new source interface will be
supported. [5]

* [sql] As a spin-off of the discussion on reworking the function catalog,
Bowen has started a discussion to support loading *external built-in
function via modules*. [6]

* [sql] Dawid proposes to rework the support for* temporary objects*
(tables/views, function) in the Table API. [7]

* [sql] Jark started a discussion on FLIP-66 to add support for *time
attributes in Flink's SQL DDL*. This means you will be able to specify
event time and processing time columns (including watermarking strategy)
via the SQL DDL. [8]

[1]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-2-released-tp33050.html
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-53%3A+Fine+Grained+Operator+Resource+Management
[3]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-56%3A+Dynamic+Slot+Allocation
[4]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Contribute-Pulsar-Flink-connector-back-to-Flink-tp32538p33055.html
[5]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Drop-older-versions-of-Kafka-Connectors-0-9-0-10-for-Flink-1-10-tp32954.html
[6]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-modular-built-in-functions-tp32918.html
[7]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-64-Support-for-Temporary-Objects-in-Table-module-tp32684.html
[8]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-66-Support-time-attribute-in-SQL-DDL-tp32766.html

Notable Bugs
==========

Overall, there were only 20 ticket bug tickets (excluding test
instabilities) updated this week, none of which seem to be particularly
relevant for a wider audience ;)

Events, Blog Posts, Misc
===================

* *Zili Chen *is now an Apache Flink committer. Congrats! [9]
* *Fabian* and *Seth* have published a blog post on the newly added *State
Processor API* on the Flink blog [10]
* *Marta *has published a Flink Community Update on the Flink blog focusing
on stats, events and ongoing initiatives in the Flink Community.[11]
* *Google *has open-sourced a *Kubernetes Operator for Flink* [12] which
automates cluster creation and job submission on Kubernetes.

[9]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zili-Chen-becomes-a-Flink-committer-tp32961.html
[10] https://flink.apache.org/feature/2019/09/13/state-processor-api.html
[11] https://flink.apache.org/news/2019/09/10/community-update.html
[12] https://github.com/GoogleCloudPlatform/flink-on-k8s-operator

Cheers,

Konstantin

--

Konstantin Knauf | Solutions Architect

[phone]


Follow us @VervericaData Ververica <https://www.ververica.com/>


--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng