[jira] [Created] (FLINK-6474) Potential loss of precision in 32 bit integer multiplication

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-6474) Potential loss of precision in 32 bit integer multiplication

Shang Yuanchun (Jira)
Ted Yu created FLINK-6474:
-----------------------------

             Summary: Potential loss of precision in 32 bit integer multiplication
                 Key: FLINK-6474
                 URL: https://issues.apache.org/jira/browse/FLINK-6474
             Project: Flink
          Issue Type: Bug
            Reporter: Ted Yu
            Priority: Minor


In TaskManagerServicesConfiguration#parseNetworkEnvironmentConfiguration
{code}
    if (!hasNewNetworkBufConf(configuration)) {
      // map old config to new one:
      networkBufMin = networkBufMax = numNetworkBuffers * pageSize;
{code}
networkBufMax is a long.
However the multiplication is done in 32 bit integer, leading to potential loss of precision.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)