[jira] [Created] (FLINK-1922) Failed task deployment causes NPE on input split assignment

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1922) Failed task deployment causes NPE on input split assignment

Shang Yuanchun (Jira)
Robert Metzger created FLINK-1922:
-------------------------------------

             Summary: Failed task deployment causes NPE on input split assignment
                 Key: FLINK-1922
                 URL: https://issues.apache.org/jira/browse/FLINK-1922
             Project: Flink
          Issue Type: Bug
          Components: JobManager
    Affects Versions: 0.9
            Reporter: Robert Metzger


The input split assignment code is returning {null} if the Task has failed, which is causing a NPE.

We should improve our error handling / reporting in that situation.

{code}
13:12:31,002 INFO  org.apache.flink.yarn.ApplicationMaster$$anonfun$2$$anon$1    - Status of job c0b47ce41e9a85a628a628a3977705ef (Flink Java Job at Tue Apr 21 13:10:36 UTC 2015) changed to FAILING Cannot deploy task - TaskManager not responding..
....
13:12:47,591 ERROR org.apache.flink.runtime.operators.RegularPactTask            - Error in task code:  CHAIN DataSource (at userMethod (org.apache.flink.api.java.io.AvroInputFormat)) -> FlatMap (FlatMap at main(UserClass.java:111)) (20/50)
java.lang.RuntimeException: Requesting the next InputSplit failed.
        at org.apache.flink.runtime.taskmanager.TaskInputSplitProvider.getNextInputSplit(TaskInputSplitProvider.java:88)
        at org.apache.flink.runtime.operators.DataSourceTask$1.hasNext(DataSourceTask.java:337)
        at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:136)
        at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:217)
        at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.NullPointerException
        at java.io.ByteArrayInputStream.<init>(ByteArrayInputStream.java:106)
        at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:301)
        at org.apache.flink.runtime.taskmanager.TaskInputSplitProvider.getNextInputSplit(TaskInputSplitProvider.java:83)
        ... 4 more
13:12:47,595 INFO  org.apache.flink.runtime.taskmanager.Task                     - CHAIN DataSource (at SomeMethod (org.apache.flink.api.java.io.AvroInputFormat)) -> FlatMap (FlatMap at main(SomeClass.java:111)) (20/50) switched to FAILED : java.lang.RuntimeException: Requesting the next InputSplit failed.
        at org.apache.flink.runtime.taskmanager.TaskInputSplitProvider.getNextInputSplit(TaskInputSplitProvider.java:88)
        at org.apache.flink.runtime.operators.DataSourceTask$1.hasNext(DataSourceTask.java:337)
        at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:136)
        at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:217)
        at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.NullPointerException
        at java.io.ByteArrayInputStream.<init>(ByteArrayInputStream.java:106)
        at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:301)
        at org.apache.flink.runtime.taskmanager.TaskInputSplitProvider.getNextInputSplit(TaskInputSplitProvider.java:83)
        ... 4 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)