[ANNOUNCE] Weekly Community Update 2019/40

[Konstantin Knauf-3]

Dear community,

happy to share this week's community update including Flink 1.9.1,
unaligned checkpoints, a new type inference system for UDFs in the Table
API and a bit more. Enjoy.

Flink Development
==============

* [releases] The vote for *Flink 1.9.1 RC1* has timed out without a vote. I
guess, Flink Forward Europe preparations in combination with Chinese
national holiday... [1]

* [runtime] Arvid has published a FLIP to support *unaligned checkpoints*.
Unaligned checkpoints could significantly reduce & stabilize checkpointing
times in high backpressure and high load scenarios and result in lower
latencies under checkpointing in general. [2]

* [runtime] Piotr has started a *survey *on dropping the *"non credit-based
flow control"-mode* in Flink's network stack. No replies so far. So, if you
are relying on it, now would be the time to raise your hand. [3]

* [logging] Gyula has started a discussion on adding *contextual
information* (taskmanager, container, job id) to *Flink's logs* and is
looking for feedback. [4]

* [sql] Timo has published FLIP-65, which proposes a *new type inference
mechanism for Table API* user-defined functions. It is based on three
levels of abstraction: automatic type inference, type hints via annotations
and manual declaration. [5]

* [code-style] Zili proposes to drop "final" from method parameters under
the assumption that all method parameters should be final anyway.
Discussion ongoing. [6]

[1]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-1-9-1-release-candidate-1-tp33637.html
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-76-Unaligned-checkpoints-tp33651.html
[3]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/SURVEY-Dropping-non-Credit-based-Flow-Control-tp33714.html
[4]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-Flink-logging-with-contextual-information-tp33729.html
[5]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-65-New-type-inference-for-Table-API-UDFs-tp33756.html
[6]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/CODE-STYLE-Parameters-of-method-are-always-final-tp33686.html

Notable Bugs
==========

Not a lot of action here, only 12 bug tickets updated this week.

* [FLINK-14315] [1.9.0] [1.8.3] A race condition in the JobManager
(JobMaster) can result in a NPE during Flink master failover. [7]

[7] https://issues.apache.org/jira/browse/FLINK-14315

Events, Blog Posts, Misc
===================

* *Parag Kesar* & *Ben Liu* of Pinterest have published a blog post on
their Flink-based real-time experimentation platform. [8]

* *Oran Hirsch* of DynamicYield describes their data architecture including
Apache Flink for stream processing in this recently published blogpost. [9]

* There will be full-day meetup with six talks in the Bangalore Kafka Group
on the 2nd of November including at least three Flink talks by *Timo Walter*
(Ververica), *Shashank Agarwal* (Razorpay) and *Rasyid Hakim* (GoJek). [10]

* *Flink Forward Europe *starts tomorrow in Berlin. Hope to see your there.
[]

[8]
https://medium.com/pinterest-engineering/real-time-experiment-analytics-at-pinterest-using-apache-flink-841c8df98dc2
[9] https://www.dynamicyield.com/blog/turning-messy-data-into-a-gold-mine/
[10] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/
[11] https://europe-2019.flink-forward.org

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

[phone]


Follow us @VervericaData Ververica <https://www.ververica.com/>


--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng