Error in during TypeExtraction

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Error in during TypeExtraction

Gyula Fóra-2
Hey,

I get a weird error when I try to execute my job on the cluster. Locally
this works fine but running it from the command line fails during
typeextraction:

input1.union(input2, input3).map(Either::<UserEvent, Long>
Left).returns(eventOrLongType);

This fails when trying to extract the output type from the mapper, but I
wouldnt actually care about that because I am providing my custom type
implementation for this Either type.

The error:
org.apache.flink.client.program.ProgramInvocationException: The main method
caused an error.
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512)
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
at org.apache.flink.client.program.Client.runBlocking(Client.java:250)
at
org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669)
at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320)
at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021)
Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
at java.util.ArrayList.elementData(ArrayList.java:418)
at java.util.ArrayList.get(ArrayList.java:431)
at
org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599)
at
org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493)
at
org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392)
at
org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273)
at
org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560)
at
org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389)
at
org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273)
at
org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110)
at
org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550)

Any ideas?

Gyula
Reply | Threaded
Open this post in threaded view
|

Re: Error in during TypeExtraction

Timo Walther-2
This looks like a bug. Can you open an issue for that? I will look into
it later.

Regards,
Timo


On 12.11.2015 13:16, Gyula Fóra wrote:

> Hey,
>
> I get a weird error when I try to execute my job on the cluster. Locally
> this works fine but running it from the command line fails during
> typeextraction:
>
> input1.union(input2, input3).map(Either::<UserEvent, Long>
> Left).returns(eventOrLongType);
>
> This fails when trying to extract the output type from the mapper, but I
> wouldnt actually care about that because I am providing my custom type
> implementation for this Either type.
>
> The error:
> org.apache.flink.client.program.ProgramInvocationException: The main method
> caused an error.
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
> at org.apache.flink.client.program.Client.runBlocking(Client.java:250)
> at
> org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669)
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320)
> at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971)
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021)
> Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
> at java.util.ArrayList.elementData(ArrayList.java:418)
> at java.util.ArrayList.get(ArrayList.java:431)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273)
> at
> org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110)
> at
> org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550)
>
> Any ideas?
>
> Gyula
>

Reply | Threaded
Open this post in threaded view
|

Re: Error in during TypeExtraction

Gyula Fóra
Thanks, I opened the JIRA: https://issues.apache.org/jira/browse/FLINK-3006

This might affect the release as well.

Timo Walther <[hidden email]> ezt írta (időpont: 2015. nov. 12., Cs,
14:56):

> This looks like a bug. Can you open an issue for that? I will look into
> it later.
>
> Regards,
> Timo
>
>
> On 12.11.2015 13:16, Gyula Fóra wrote:
> > Hey,
> >
> > I get a weird error when I try to execute my job on the cluster. Locally
> > this works fine but running it from the command line fails during
> > typeextraction:
> >
> > input1.union(input2, input3).map(Either::<UserEvent, Long>
> > Left).returns(eventOrLongType);
> >
> > This fails when trying to extract the output type from the mapper, but I
> > wouldnt actually care about that because I am providing my custom type
> > implementation for this Either type.
> >
> > The error:
> > org.apache.flink.client.program.ProgramInvocationException: The main
> method
> > caused an error.
> > at
> >
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:512)
> > at
> >
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
> > at org.apache.flink.client.program.Client.runBlocking(Client.java:250)
> > at
> >
> org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:669)
> > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:320)
> > at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:971)
> > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1021)
> > Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
> > at java.util.ArrayList.elementData(ArrayList.java:418)
> > at java.util.ArrayList.get(ArrayList.java:431)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoFromInputs(TypeExtractor.java:599)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:493)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo(TypeExtractor.java:1392)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.privateGetForClass(TypeExtractor.java:1273)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfoWithTypeHierarchy(TypeExtractor.java:560)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.privateCreateTypeInfo(TypeExtractor.java:389)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorReturnType(TypeExtractor.java:273)
> > at
> >
> org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(TypeExtractor.java:110)
> > at
> >
> org.apache.flink.streaming.api.datastream.DataStream.map(DataStream.java:550)
> >
> > Any ideas?
> >
> > Gyula
> >
>
>