[jira] [Created] (FLINK-11050) When IntervalJoin, get left or right buffer's entries more quickly by assigning lowerBound

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11050) When IntervalJoin, get left or right buffer's entries more quickly by assigning lowerBound

Shang Yuanchun (Jira)
Liu created FLINK-11050:
---------------------------

             Summary: When IntervalJoin, get left or right buffer's entries more quickly by assigning lowerBound
                 Key: FLINK-11050
                 URL: https://issues.apache.org/jira/browse/FLINK-11050
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.7.0, 1.6.2
            Reporter: Liu
             Fix For: 1.7.1


When IntervalJoin, it is very slow to get left or right buffer's entries. Because we have to scan all buffer's values, including the deleted values which are out of time range. These deleted values's processing consumes too much time in RocksDB's level 0. Since lowerBound is known, it can be optimized by seek from the timestamp of lowerBound.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)