[jira] [Created] (FLINK-3788) Local variable values are not distributed to task runners

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3788) Local variable values are not distributed to task runners

Shang Yuanchun (Jira)
Andreas C. Osowski created FLINK-3788:
-----------------------------------------

             Summary: Local variable values are not distributed to task runners
                 Key: FLINK-3788
                 URL: https://issues.apache.org/jira/browse/FLINK-3788
             Project: Flink
          Issue Type: Bug
          Components: DataSet API
    Affects Versions: 1.0.1, 1.0.0
         Environment: Scala 2.11.8
Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77
Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64
            Reporter: Andreas C. Osowski


Variable values of non-elementary types aren't caught and distributed to job runners, causing them to remain 'null' and causing NPEs upon access when running on a cluster. Running locally through `flink-clients` works fine.

Changing parallelism or disabling the closure cleaner don't seem to have any effect.

Minimal example, also see the attached archive.
{code:java}
case class IntWrapper(a1: Int)
val wrapped = IntWrapper(42)
env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)