[jira] [Created] (FLINK-4125) Yarn CLI incorrectly calculates slotsPerTM when parallelism < task manager count

classic Classic list List threaded Threaded
♦
♦
2 messages Options
Reply | Threaded
Open this post in threaded view
♦
♦
|

[jira] [Created] (FLINK-4125) Yarn CLI incorrectly calculates slotsPerTM when parallelism < task manager count

Shang Yuanchun (Jira)
Chris Hogue created FLINK-4125:
----------------------------------

             Summary: Yarn CLI incorrectly calculates slotsPerTM when parallelism < task manager count
                 Key: FLINK-4125
                 URL: https://issues.apache.org/jira/browse/FLINK-4125
             Project: Flink
          Issue Type: Bug
            Reporter: Chris Hogue
            Priority: Minor


The FlinkYarnSessionCli class tries to calculate how many slots each taskmanager gets based on the user-supplied parallelism option. It's using an int, so when -p < -yn it is truncated to 0 and the cluster then fails to start, saying slots per TM must be positive. And example command to trigger this would be:

bin/flink run -m yarn-cluster -d -yn 20 -ys 2 -p 5 <a jar>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: [jira] [Created] (FLINK-4125) Yarn CLI incorrectly calculates slotsPerTM when parallelism < task manager count

jacktaylor555888@gmail.com
The Yarn CLI issue highlights the importance of accurate resource and task allocation when running distributed workloads, particularly when parallelism is lower than the available TaskManagers. For readers interested in careful, detail-oriented work and quality materials, Bernat offers premium blanket, baby, and velvet yarn designed for smooth knitting and crochet projects. Its soft chenille and plush fibers provide a practical balance of comfort and durability for makers creating everything from everyday pieces to detailed handmade designs.