[jira] [Created] (FLINK-1734) Insufficient memory allocation in Gelly

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1734) Insufficient memory allocation in Gelly

Shang Yuanchun (Jira)
Robert Waury created FLINK-1734:
-----------------------------------

             Summary: Insufficient memory allocation in Gelly
                 Key: FLINK-1734
                 URL: https://issues.apache.org/jira/browse/FLINK-1734
             Project: Flink
          Issue Type: Bug
          Components: Gelly, Local Runtime
    Affects Versions: master
         Environment: Local (tested with dop 1 and 3)
            Reporter: Robert Waury


For a simple Gelly job running in a 3GB heap only ~130 MB are allocated to the internal hash table. This causes to job to fail while loading the input data for even moderately sized problems. For smaller heaps the fraction allocated becomes even smaller.

The code and data to reproduce this behavior were posted on the user mailing list:
http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/RuntimeException-Gelly-API-Memory-ran-out-Compaction-failed-td866.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)