[jira] [Created] (FLINK-5305) Documentation of collect() should mention parameter akka.framesize

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5305) Documentation of collect() should mention parameter akka.framesize

Shang Yuanchun (Jira)
Arnaud Linz created FLINK-5305:
----------------------------------

             Summary: Documentation of collect() should mention parameter akka.framesize
                 Key: FLINK-5305
                 URL: https://issues.apache.org/jira/browse/FLINK-5305
             Project: Flink
          Issue Type: Improvement
          Components: Documentation
    Affects Versions: 1.1.3
            Reporter: Arnaud Linz
            Priority: Minor


When calling collect() on a big dataset, if the data size exceeds the value of akka.framesize, which is 10Mb by default, the collect() freezes and some "akka payload size exceeded" logs appear in the yarn logs (but neither in the flink console output nor UI logs).

10Mb is not that big, and its relation to akka.framesize is hard to find in the documentation (in Flink internals section). I believe that the "easy to find" collect documentation should mention this parameter to save hours of users time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)