Stefan Bunk created FLINK-1090:
----------------------------------
Summary: Join deadlocks when used inside Delta iteration
Key: FLINK-1090
URL:
https://issues.apache.org/jira/browse/FLINK-1090 Project: Flink
Issue Type: Bug
Components: Distributed Runtime, Iterations, Scala API
Affects Versions: 0.6-incubating
Environment: Ubuntu 14.04, Flink 0.6-incubating
LocalExecutor
JVM 1.7 with 7 GB RAM assigned
Reporter: Stefan Bunk
I have a join inside a delta iteration, which hangs, i.e.I think it's deadlocked.
If I do the join without a delta iteration, it works.
_Why I think it's a deadlock_:
- no output in the logs
- CPU idles
- no IO (measured using iotop)
- stacktrace (when starting in debug mode and stopping at arbitrary points) locks deadlockish !
http://i.imgur.com/4TgSK3x.png!_Join properties_:
- size of the operands: 6.1 GB, 257 MB
- estimated result size: 50 MB
- the deadlock only occurs for big inputs, if I decrease the size of the first operand to something smaller, e.g. 1MB, it works.
I am using the Scala API.
Let me know, which further information you need.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Locked
