[jira] [Created] (FLINK-14811) Replace Java Streams with for-loops in vertex input checking

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14811) Replace Java Streams with for-loops in vertex input checking

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-14811:
-------------------------------

             Summary: Replace Java Streams with for-loops in vertex input checking
                 Key: FLINK-14811
                 URL: https://issues.apache.org/jira/browse/FLINK-14811
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.10.0
            Reporter: Zhu Zhu


Vertex input checking is invoked in lazily triggered scheduling by a FINISHED vertex state update RPC or a {{scheduleOrUpdateConsumers}} RPC.
Java Streams is used in it, but it should be avoided since it is performance critical code. See ref [1] and [2].
We should refactor these Java Streams to improve the performance, for both legacy scheduler and NG schedulers.

cc [~sewen] [~gjy]


[1] [flink code style guide|https://flink.apache.org/contributing/code-style-and-quality-java.html]
[2] [discussion & performance test|https://issues.apache.org/jira/browse/FLINK-14735?focusedCommentId=16974209&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16974209] which compares the performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)