[jira] [Created] (FLINK-18203) Reduce objects usage in redistributing union states

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18203) Reduce objects usage in redistributing union states

Shang Yuanchun (Jira)
Jiayi Liao created FLINK-18203:
----------------------------------

             Summary: Reduce objects usage in redistributing union states
                 Key: FLINK-18203
                 URL: https://issues.apache.org/jira/browse/FLINK-18203
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.10.1
            Reporter: Jiayi Liao


#{{RoundRobinOperatorStateRepartitioner}}#{{repartitionUnionState}} creates a new {{OperatorStreamStateHandle}} instance for every {{StreamStateHandle}} instance used in every execution, which causes the number of new {{OperatorStreamStateHandle}} instances up to m * n (jobvertex parallelism * count of all executions' StreamStateHandle).

But in fact, all executions can share the same collection of {{StreamStateHandle}} because it's **union state**.





--
This message was sent by Atlassian Jira
(v8.3.4#803005)