Nico Kruber created FLINK-17171:
-----------------------------------
Summary: Blink planner fails to compile Table program with POJO source
Key: FLINK-17171
URL:
https://issues.apache.org/jira/browse/FLINK-17171 Project: Flink
Issue Type: Bug
Components: Table SQL / Planner, Table SQL / Runtime
Affects Versions: 1.10.0
Reporter: Nico Kruber
Attachments: error.log
It seems as if FLINK-13993 made the Table API (Blink planner) unusable for POJO sources where the POJO class is in user code.
For
https://github.com/ververica/lab-sql-vs-datastream/blob/master/src/main/java/com/ververica/LateralTableJoin.java I get the following Exception when I run it on a Flink 1.10.0 cluster (full version attached):
{code}
2020-04-15 17:19:15,561 ERROR org.apache.flink.runtime.webmonitor.handlers.JarRunHandler - Unhandled exception.
org.apache.flink.util.FlinkRuntimeException: org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.
...
Caused by: org.codehaus.commons.compiler.CompileException: Line 28, Column 175: Cannot determine simple type name "com"
...
at org.apache.flink.table.runtime.generated.CompileUtils.doCompile(CompileUtils.java:78)
{code}
I enabled debug logs and this is what it is trying to compile:
{code}
@Override
public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord element) throws Exception {
org.apache.flink.table.dataformat.BaseRow in1 = (org.apache.flink.table.dataformat.BaseRow) (org.apache.flink.table.dataformat.BaseRow) converter$15.toInternal((com.ververica.tables.FactTable.Fact) element.getValue());
...
{code}
I use a standalone cluster and submit via web UI and also verified that my jar file does not contain anything else but its compiled classes.
This code is working fine inside the IDE and was also working with Flink 1.10 and VVP 2.0 which did not use a dedicated class loader for user code.
My guess is that the (generated) code does not have access to {{FactTable.Fact}} and the Janino compiler does not produce the right error message seeing "com" as a primitive type instead.
FLINK-7490 and FLINK-9220 seem related but too old (legacy planner).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
