NPE in DataStream

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

NPE in DataStream

Abderrazak TAZARNI
Hi,

In my Flink cluster , i have continuously an NPE:

java.lang.NullPointerException
at
org.apache.flink.streaming.runtime.tasks.StreamTask.createRecordWriters(StreamTask.java:1175)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.<init>(StreamTask.java:212)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.<init>(StreamTask.java:190)
at
org.apache.flink.streaming.runtime.tasks.TwoInputStreamTask.<init>(TwoInputStreamTask.java:55)
at sun.reflect.GeneratedConstructorAccessor29.newInstance(Unknown Source)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:1405)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:689)
at java.lang.Thread.run(Thread.java:748)

And same times i have just  : java.lang.NullPointerException sans aucune
stacktrace.

While processing a DataStream some time i have a null object in the stream!
logically we shouldn't.
For example we have this code

exemple :

aDataStream.map(new MyPOJOFilter())...;   this code generate an NPE

 and when i add a filter for the null elements :
aDataStream.filter(data-> null != data).map(new MyPOJOFilter())...; it
works !

Can some one help;

Regards.


--
Cordialement,Regards.