[jira] [Created] (FLINK-3456) Backpressure Monitoring does not work for Kafka Sources

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3456) Backpressure Monitoring does not work for Kafka Sources

Shang Yuanchun (Jira)
Stephan Ewen created FLINK-3456:
-----------------------------------

             Summary: Backpressure Monitoring does not work for Kafka Sources
                 Key: FLINK-3456
                 URL: https://issues.apache.org/jira/browse/FLINK-3456
             Project: Flink
          Issue Type: Bug
          Components: Distributed Runtime
    Affects Versions: 1.0.0
            Reporter: Stephan Ewen


For sources that run with Kafka 0.8, the main thread is not the thread that processes elements and pushes them into the network. The Kafka fetcher threads actually emit elements to the SourceContext.

Because the backpressure sampler samples the main thread, it does not correctly handle Kafka Sources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)