[jira] [Created] (FLINK-11063) Make flink-table Scala-free

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11063) Make flink-table Scala-free

Shang Yuanchun (Jira)
Timo Walther created FLINK-11063:
------------------------------------

             Summary: Make flink-table Scala-free
                 Key: FLINK-11063
                 URL: https://issues.apache.org/jira/browse/FLINK-11063
             Project: Flink
          Issue Type: New Feature
          Components: Table API & SQL
            Reporter: Timo Walther


Currently, the Table & SQL API is implemented in Scala. This decision was made a long-time ago when the initial code base was created as part of a master's thesis. The community kept Scala because of the nice language features that enable a fluent Table API like {{table.select('field.trim())}} and because Scala allows for quick prototyping (e.g. multi-line comments for code generation). The committers enforced not splitting the code-base into two programming languages.

However, nowadays the {{flink-table}} module more and more becomes an important part in the Flink ecosystem. Connectors, formats, and SQL client are actually implemented in Java but need to interoperate with {{flink-table}} which makes these modules dependent on Scala. As mentioned in an earlier mail thread, using Scala for API classes also exposes member variables and methods in Java that should not be exposed to users. Java is still the most important API language and right now we treat it as a second-class citizen.

In order to not introduce more technical debt, the community aims to make the {{flink-table}} module Scala-free as a long-term goal. This will be a continuous effort that can not be finished within one release. We aim for avoiding API-breaking changes.

A full description can be found in the corresponding [FLIP-28|https://cwiki.apache.org/confluence/display/FLINK/FLIP-28%3A+Long-term+goal+of+making+flink-table+Scala-free].

FLIP-28 also contains a rough roadmap and serves as migration guidelines.

This Jira issue is an umbrella issue for tracking the efforts and possible migration blockers.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)