[jira] [Created] (FLINK-9597) Flink fail to scale!

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-9597) Flink fail to scale!

Shang Yuanchun (Jira)
swy created FLINK-9597:
--------------------------

             Summary: Flink fail to scale!
                 Key: FLINK-9597
                 URL: https://issues.apache.org/jira/browse/FLINK-9597
             Project: Flink
          Issue Type: Bug
          Components: Core
    Affects Versions: 1.5.0
            Reporter: swy


Hi, we found that our Flink application with simple logic, which using process function is not scale-able when scale from 8 parallelism onward even though with sufficient resources. Below it the result where is capped at around 250k TPS. No matter how we tune the parallelism of the operators it just not work, same to increase source parallelism.

Please refer to "scaleNotWork.png"
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)