[jira] [Created] (FLINK-14575) Wrong (parent-first) class loader during serialization while submitting jobs

[Shang Yuanchun (Jira)]

Nico Kruber created FLINK-14575:
-----------------------------------

             Summary: Wrong (parent-first) class loader during serialization while submitting jobs
                 Key: FLINK-14575
                 URL: https://issues.apache.org/jira/browse/FLINK-14575
             Project: Flink
          Issue Type: Bug
          Components: Client / Job Submission
    Affects Versions: 1.9.1, 1.8.2
            Reporter: Nico Kruber


When building the user code classloader for job submission, Flink uses a parent first class loader for serializing the ExecutionConfig which may lead to problems in the following case:

# have hadoop in the system class loader from lib/ (this also provides avro 1.8.3)
# have a user jar with a newer avro, e.g. 1.9.1
# register an Avro class with the execution config, e.g. through {{registerPojoType}} (please ignore for a second that this is not needed)

During submission, a parent-first classloader will be used and thus, avro 1.8.3 will be used which does not map the version in the user classloader that will be used for deserialization.

Exception during submission:

{code}
Caused by: java.io.InvalidClassException: org.apache.avro.specific.SpecificRecordBase; local class incompatible: stream classdesc serialVersionUID = 189988654766568477, local class serialVersionUID = -1463700717714793795
        at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
        at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
        at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
        at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
        at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
        at java.io.ObjectInputStream.readClass(ObjectInputStream.java:1716)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1556)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
        at java.util.HashSet.readObject(HashSet.java:341)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1170)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2178)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
        at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:566)
        at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:552)
        at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:540)
        at org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:58)
        at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:278)
        at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:83)
        at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:37)
        at org.apache.flink.runtime.jobmaster.JobManagerRunner.<init>(JobManagerRunner.java:146)
        ... 10 more
{code}

The incriminating code is in
* Flink 1.8.0: {{org.apache.flink.client.program.JobWithJars#buildUserCodeClassLoader}}
* Flink master: {{org.apache.flink.client.ClientUtils#buildUserCodeClassLoader}}

Thanks [~chesnay] for looking into this with me. [~aljoscha] Do you know why we use parent-first there?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)