[jira] [Created] (FLINK-15465) Avoid failing when required memory calculation not accurate in BinaryHashTable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15465) Avoid failing when required memory calculation not accurate in BinaryHashTable

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-15465:
------------------------------------

             Summary: Avoid failing when required memory calculation not accurate in BinaryHashTable
                 Key: FLINK-15465
                 URL: https://issues.apache.org/jira/browse/FLINK-15465
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / Runtime
            Reporter: Jingsong Lee
             Fix For: 1.10.0


In BinaryHashBucketArea.insertToBucket.

When BinaryHashTable.buildTableFromSpilledPartition."Build in memory hash table", it requires memory can put all records, if not, will fail.

Because the linked hash conflict solution, the required memory calculation are not accurate, in this case, we should apply for insufficient memory from heap.

And must be careful, the steal memory should not return to table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)