[jira] [Created] (FLINK-18767) Streaming job stuck when disabling operator chaining

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18767) Streaming job stuck when disabling operator chaining

Shang Yuanchun (Jira)
Nico Kruber created FLINK-18767:
-----------------------------------

             Summary: Streaming job stuck when disabling operator chaining
                 Key: FLINK-18767
                 URL: https://issues.apache.org/jira/browse/FLINK-18767
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
    Affects Versions: 1.11.1, 1.10.1, 1.9.3, 1.8.3
            Reporter: Nico Kruber


The following code is stuck sending data from the source to the map operator. Two settings seem to have an influence here: {{env.setBufferTimeout(-1);}} and {{env.disableOperatorChaining();}} - if I remove either of these, the job works as expected.

(I pre-populated my Kafka topic with one element to reproduce easily)

{code}
    StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();

    // comment either these two and the job works
    env.setBufferTimeout(-1);
    env.disableOperatorChaining();

    Properties properties = new Properties();
    properties.setProperty("bootstrap.servers", "localhost:9092");
    properties.setProperty("group.id", "test");
    FlinkKafkaConsumer<String> consumer = new FlinkKafkaConsumer<>("topic", new SimpleStringSchema(),
        properties);
    consumer.setStartFromEarliest();
    DataStreamSource<String> input = env.addSource(
        consumer);

    input
        .map((x) -> x)
        .print();

    env.execute();
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)