[jira] [Created] (FLINK-15773) ClosureCleaner fails with joda DateTimeZone

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15773) ClosureCleaner fails with joda DateTimeZone

Shang Yuanchun (Jira)
Jozef Vilcek created FLINK-15773:
------------------------------------

             Summary: ClosureCleaner fails with joda DateTimeZone
                 Key: FLINK-15773
                 URL: https://issues.apache.org/jira/browse/FLINK-15773
             Project: Flink
          Issue Type: Bug
          Components: API / Core
    Affects Versions: 1.9.1
            Reporter: Jozef Vilcek


Flink fails to launch my Apache Beam job which uses windowing function with time zone. Closure cleaner reports time zone as not serializable. Part of stack trace:

 
{noformat}
org.joda.time.tz.DateTimeZoneBuilder$OfYear@3b035d0c is not serializable. The object probably contains or references non serializable fields.
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:151)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:71)
        org.apache.flink.api.java.DataSet.clean(DataSet.java:186)
        org.apache.flink.api.java.DataSet.flatMap(DataSet.java:267)
 ....{noformat}
Actual instance of DateTimeZone is [PrecalculatedZone|[https://github.com/JodaOrg/joda-time/blob/v2.10.5/src/main/java/org/joda/time/tz/DateTimeZoneBuilder.java#L1373]] which itself is serializable but it's fields are not necessarily standalone java serializable, because enclosing class it managing their serialization and deserialization. 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)