Hey,
I get a weird error when I try to execute my job on the cluster. Locally this works fine but running it from the command line fails during typeextraction: input1.union(input2, input3).map(Either::<UserEvent, Long> Left).returns(eventOrLongType); This fails when trying to extract the output type from the mapper, but I wouldnt actually care about that because I am providing my custom type implementation for this Either type. The error: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error. at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395) at org.apache.flink.client.program.Client.runBlocking(Client.java:250) at org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669) at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971) at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021) Caused by: java.lang.ArrayIndexOutOfBoundsException: -1 at java.util.ArrayList.elementData(ArrayList.java:418) at java.util.ArrayList.get(ArrayList.java:431) at org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599) at org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493) at org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392) at org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273) at org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560) at org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389) at org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273) at org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110) at org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550) Any ideas? Gyula |
This looks like a bug. Can you open an issue for that? I will look into
it later. Regards, Timo On 12.11.2015 13:16, Gyula Fóra wrote: > Hey, > > I get a weird error when I try to execute my job on the cluster. Locally > this works fine but running it from the command line fails during > typeextraction: > > input1.union(input2, input3).map(Either::<UserEvent, Long> > Left).returns(eventOrLongType); > > This fails when trying to extract the output type from the mapper, but I > wouldnt actually care about that because I am providing my custom type > implementation for this Either type. > > The error: > org.apache.flink.client.program.ProgramInvocationException: The main method > caused an error. > at > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512) > at > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395) > at org.apache.flink.client.program.Client.runBlocking(Client.java:250) > at > org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669) > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320) > at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971) > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021) > Caused by: java.lang.ArrayIndexOutOfBoundsException: -1 > at java.util.ArrayList.elementData(ArrayList.java:418) > at java.util.ArrayList.get(ArrayList.java:431) > at > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599) > at > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493) > at > org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392) > at > org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273) > at > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560) > at > org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389) > at > org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273) > at > org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110) > at > org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550) > > Any ideas? > > Gyula > |
Thanks, I opened the JIRA: https://issues.apache.org/jira/browse/FLINK-3006
This might affect the release as well. Timo Walther <[hidden email]> ezt írta (időpont: 2015. nov. 12., Cs, 14:56): > This looks like a bug. Can you open an issue for that? I will look into > it later. > > Regards, > Timo > > > On 12.11.2015 13:16, Gyula Fóra wrote: > > Hey, > > > > I get a weird error when I try to execute my job on the cluster. Locally > > this works fine but running it from the command line fails during > > typeextraction: > > > > input1.union(input2, input3).map(Either::<UserEvent, Long> > > Left).returns(eventOrLongType); > > > > This fails when trying to extract the output type from the mapper, but I > > wouldnt actually care about that because I am providing my custom type > > implementation for this Either type. > > > > The error: > > org.apache.flink.client.program.ProgramInvocationException: The main > method > > caused an error. > > at > > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512) > > at > > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395) > > at org.apache.flink.client.program.Client.runBlocking(Client.java:250) > > at > > > org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669) > > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320) > > at > org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971) > > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021) > > Caused by: java.lang.ArrayIndexOutOfBoundsException: -1 > > at java.util.ArrayList.elementData(ArrayList.java:418) > > at java.util.ArrayList.get(ArrayList.java:431) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273) > > at > > > org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110) > > at > > > org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550) > > > > Any ideas? > > > > Gyula > > > > |
Free forum by Nabble | Edit this page |