[jira] [Created] (FLINK-5429) Code generate types between operators in Table API

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5429) Code generate types between operators in Table API

Shang Yuanchun (Jira)
Timo Walther created FLINK-5429:
-----------------------------------

             Summary: Code generate types between operators in Table API
                 Key: FLINK-5429
                 URL: https://issues.apache.org/jira/browse/FLINK-5429
             Project: Flink
          Issue Type: New Feature
          Components: Table API & SQL
            Reporter: Timo Walther


Currently, the Table API uses the generic Row type for shipping records between operators in underlying DataSet and DataStream API. For efficiency reasons we should code generate those records. The final design is up for discussion but here are some ideas:

A row like {{(a: INT NULL, b: INT NOT NULL, c: STRING)}} could look like

{code}
final class GeneratedRow$123 {
  public boolean a_isNull;
  public int a;

  public int b;
  public String c;
}
{code}

Types could be generated using Janino in the pre-flight phase. The generated types should use primitive types wherever possible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)