Chesnay Schepler created FLINK-10243:
----------------------------------------
Summary: Add option to reduce latency metrics granularity
Key: FLINK-10243
URL:
https://issues.apache.org/jira/browse/FLINK-10243 Project: Flink
Issue Type: Sub-task
Components: Configuration, Metrics
Affects Versions: 1.7.0
Reporter: Chesnay Schepler
Assignee: Chesnay Schepler
Fix For: 1.7.0
The latency is currently tracked separately from each operator subtask to each source subtask. The total number of latency metrics in the cluster is thus {{(# of sources) * (# of operators) * parallelism²}}, i.e. quadratic scaling.
If we'd ignore the source subtask the scaling would be a lot more manageable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)