Re: [GitHub] incubator-flink pull request: Do not limit the client's heap space...
Posted by
Ufuk Celebi on
Jun 15, 2014; 7:08pm
URL: http://deprecated-apache-flink-mailing-list-archive.368.s1.nabble.com/GitHub-incubator-flink-pull-request-Do-not-limit-the-client-s-heap-space-tp231p259.html
On 15 Jun 2014, at 20:08, warneke <
[hidden email]> wrote:
> Github user warneke commented on the pull request:
>
>
https://github.com/apache/incubator-flink/pull/18#issuecomment-46122924>
> Using RPCs to distribute jar files is still the quick hack from the very early days of the project. I've already fixed this issue on several branches but I guess the change did not make it to the upstream code. I could offer to take care of this problem, either through some sort of HTTP transfer or by leveraging the distributed file system.
>
Hey Daniel! Too bad that the change did not make it upstream :( What did you use in the other branches? HTTP? DFS? I would prefer HTTP over DFS. But we could also easily implement the service on top of Netty (should basically be just an outbound handler which reads the file and directly sends it out and vice versa for the inbound handler).