[jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service

Shang Yuanchun (Jira)

    [ https://issues.apache.org/jira/browse/FLINK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034275#comment-14034275 ]

Daniel Warneke commented on FLINK-939:
--------------------------------------

Hi Stephan,

I like your idea and will start to build a first prototype for discussion as soon as possible. Your put API implies that the data to be written fits into memory? Do you think that's a reasonable assumption?

Do you want me to integrate the BlobManager with the current RPC service or shall I work directly on Asterios' branch?

> Distribute required JAR files with seperate service
> ---------------------------------------------------
>
>                 Key: FLINK-939
>                 URL: https://issues.apache.org/jira/browse/FLINK-939
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Ufuk Celebi
>            Assignee: Daniel Warneke
>
> Currently, required user JAR files are distributed via the RPC service in {{JobGraph.writeRequiredJarFiles(DataOutput, AbstractJobVertex[])}}. The RPC service then tries to allocate a buffer on the client side heap to write the on-disk JAR, which [can lead to problems|https://github.com/apache/incubator-flink/pull/18].
> This should be replaced with a seperate service.



--
This message was sent by Atlassian JIRA
(v6.2#6252)