[jira] [Created] (FLINK-13707) Make max parallelism configurable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13707) Make max parallelism configurable

Shang Yuanchun (Jira)
xuekang created FLINK-13707:
-------------------------------

             Summary: Make  max parallelism configurable
                 Key: FLINK-13707
                 URL: https://issues.apache.org/jira/browse/FLINK-13707
             Project: Flink
          Issue Type: New Feature
          Components: API / DataStream
            Reporter: xuekang


For now, if a user set parallelism larger than 128, and does not set max parallelism explicitly, the system will compute a max parallelism, which is 1.5 * parallelism.  When the job changes the parallelism and recover from a savepoint, there may be some problem when restoring states from the savepoint, as the number of key groups changed.

To avoid this problem, and trying not to modify the code of existing jobs,  we want to configure the default max parallelism in flink-conf.yaml, but it is not configurable now.

Should we make it configurable? Any comments would be appreciated.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)