[jira] [Created] (FLINK-11890) Replace Table API string-based expressions by a Java DSL

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11890) Replace Table API string-based expressions by a Java DSL

Shang Yuanchun (Jira)
Timo Walther created FLINK-11890:
------------------------------------

             Summary: Replace Table API string-based expressions by a Java DSL
                 Key: FLINK-11890
                 URL: https://issues.apache.org/jira/browse/FLINK-11890
             Project: Flink
          Issue Type: New Feature
          Components: API / Table SQL
            Reporter: Timo Walther
            Assignee: Timo Walther


Currently, expressions in the Table API can be defined in two ways. Either via the implicit Scala DSL or via custom strings:

{code}
Table revenue = orders
  .filter("cCountry === 'FRANCE'")
  .groupBy("cID, cName")
  .select("cID, cName, revenue.sum AS revSum");

// vs.

val revenue = orders
  .filter('cCountry === "FRANCE")
  .groupBy('cID, 'cName)
  .select('cID, 'cName, 'revenue.sum AS 'revSum)
{code}

The Java version of the Table API was always treated as a third class citizen.

In the past the string-based expression parser was/is:
- multiple times out of sync with the Scala DSL
- buggy because it was not properly tested
- it blows up the API as every method must accept both representations like {{select(String)}} and {{select(Expression)}}
- confusing for users because it looks like SQL but is actually only SQL-like
- does not provide JavaDocs or further help in case of parse errors within the IDE, a user can only consult the online documentation

We should discuss alternatives for the string-based expressions and might come up with a DSL-like approach to make the Table API ready for the future.

This issue would be a big design shift for Table API users in Java. We need to discuss if the benefits are worth the change. A first proof-of-concept/design proposal will follow shortly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)