[ANNOUNCE] Weekly Community Update 2019/42

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[ANNOUNCE] Weekly Community Update 2019/42

Konstantin Knauf-3
Dear community,

happy to share this week's community update with the release of Flink
1.9.1, a couple of threads about our development process, the sql ecosystem
and more.

Flink Development
==============

* [releases] *Apache Flink 1.9.1* was released. [1,2]

* [statefun] Stephan has started a separate discussion on whether to
maintain *Stateful Functions* in a separate repository or the Flink main
repository after its contribution to Apache Flink. The majority seems to
prefer a separate repository e.g. to enable quicker iterations on the new
code base and not to overwhelm new contributors to Stateful Functions. [3]

* [development process] The *NOTICE* file and the directory for licenses of
bundled dependencies for binary releases is now auto-generated during the
release process. [4]

* [development process] According to our *FLIP process* the introduction of
a new config option requires a FLIP (and vote). Aljoscha has started a
discussion to clarify this point, as this is currently not always the case.
Looks like the majority leans towards a vote for every configuration
change, but possibly making it more lightweight than a proper FLIP. [5]

* [development process] Xiyuan gave an update on *Flink's ARM support.*
Travis ARM Support is in alpha now (alternative to previously proposed
OpenLab), and regardless of the CI system
Xiyuan points the community to a list of PRs/Jiras, which need to be
solved/reviewed. [6]

* [configuration] The discussion on FLIP-59 to make the execution
configuration (ExecutionConfig et al.) configurable via the Flink
Configuration has been revived a bit and focuses on alignment with FLIP-73
and naming of the different configurations now. [7]

* [sql] Based on feedback from the user community, Timo proposes to rename
the "ANY" datatype "OPAQUE" highlighting that a field of type "ANY" does
not hold any type, but a data type that is unknown to Flink. [8]

* [sql] Jark has started a discussion on FLIP-80 [9] about how to
de/serialize expressions in catalogs. [10]

[1]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-9-1-released-tp34170.html
[2] https://flink.apache.org/news/2019/10/18/release-1.9.1.html
[3]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Stateful-Functions-in-which-form-to-contribute-same-or-different-repository-tp34034.html
[4]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/NOTICE-Binary-licensing-is-now-auto-generated-tp34121.html
[5]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-policy-for-introducing-config-option-keys-tp34011p34045.html
[6]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ARM-support-Travis-ARM-CI-is-now-in-Alpha-Release-tp34039.html
[7]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-59-Enable-execution-configuration-from-Configuration-object-tp32359.html
[8]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Rename-the-SQL-ANY-type-to-OPAQUE-type-tp34162.html
[9]
https://docs.google.com/document/d/1LxPEzbPuEVWNixb1L_USv0gFgjRMgoZuMsAecS_XvdE/edit?usp=sharing
[10]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISUCSS-FLIP-80-Expression-String-Serializable-and-Deserializable-tp34146.html

Notable Bugs
==========

* [FLINK-14429] [1.9.1] [1.8.2] When you run a batch job on YARN in
non-detached mode, it will be reported as SUCCEEDED if when it actually
FAILED. [11]

[11] https://issues.apache.org/jira/browse/FLINK-14429

Events, Blog Posts, Misc
===================

* This discussion on the dev@ mailing list might be interesting to follow
for people using the StreamingFileSink or BucketingSink with S3.  [12]

* There will be full-day meetup with six talks in the Bangalore Kafka Group
on the 2nd of November including at least three Flink talks by *Timo Walter*
(Ververica), *Shashank Agarwal* (Razorpay) and *Rasyid Hakim* (GoJek).  [13]

[12]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/performances-of-S3-writing-with-many-buckets-in-parallel-tp34021p34050.html
[13] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

+49 160 91394525


Follow us @VervericaData Ververica <https://www.ververica.com/>


--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Tony) Cheng