[jira] [Created] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[Shang Yuanchun (Jira)]

Jark Wu created FLINK-20039:
-------------------------------

             Summary: Streaming File Sink end-to-end test is unstable on Azure
                 Key: FLINK-20039
                 URL: https://issues.apache.org/jira/browse/FLINK-20039
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem
    Affects Versions: 1.12.0
            Reporter: Jark Wu


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=9211&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=ff888d9b-cd34-53cc-d90f-3e446d355529


{code}
2020-11-06T19:56:33.5300892Z Nov 06 19:56:33 ==============================================================================
2020-11-06T19:56:33.5301454Z Nov 06 19:56:33 Running 'Streaming File Sink end-to-end test'
2020-11-06T19:56:33.5301877Z Nov 06 19:56:33 ==============================================================================
2020-11-06T19:56:33.5315153Z Nov 06 19:56:33 TEST_DATA_DIR: /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-33530977067
2020-11-06T19:56:33.6838741Z /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/test-runner-common.sh: line 57: /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/test_streaming_file_sink.sh: No such file or directory
2020-11-06T19:56:33.6839644Z Nov 06 19:56:33 [FAIL] Test script contains errors.
2020-11-06T19:56:33.6847199Z Nov 06 19:56:33 Checking of logs skipped.
2020-11-06T19:56:33.6847743Z Nov 06 19:56:33
2020-11-06T19:56:33.6848433Z Nov 06 19:56:33 [FAIL] 'Streaming File Sink end-to-end test' failed after 0 minutes and 0 seconds! Test exited with exit code 1
2020-11-06T19:56:33.6848756Z Nov 06 19:56:33
2020-11-06T19:56:33.6849046Z Nov 06 19:56:33 ##[group]Environment Information
2020-11-06T19:56:33.6849260Z Nov 06 19:56:33 Jps
2020-11-06T19:56:33.7825775Z Nov 06 19:56:33 77536 Jps
2020-11-06T19:56:33.7946109Z Nov 06 19:56:33 Disk information
2020-11-06T19:56:33.7958895Z Nov 06 19:56:33 Filesystem      Size  Used Avail Use% Mounted on
2020-11-06T19:56:33.7959315Z Nov 06 19:56:33 udev            3.7G     0  3.7G   0% /dev
2020-11-06T19:56:33.7959726Z Nov 06 19:56:33 tmpfs           729M   18M  712M   3% /run
2020-11-06T19:56:33.7960079Z Nov 06 19:56:33 /dev/sda1        90G   63G   28G  70% /
2020-11-06T19:56:33.7960411Z Nov 06 19:56:33 tmpfs           3.7G  8.2k  3.7G   1% /dev/shm
2020-11-06T19:56:33.7960765Z Nov 06 19:56:33 tmpfs           5.3M     0  5.3M   0% /run/lock
2020-11-06T19:56:33.7961111Z Nov 06 19:56:33 tmpfs           3.7G     0  3.7G   0% /sys/fs/cgroup
2020-11-06T19:56:33.7961479Z Nov 06 19:56:33 /dev/sda15      110M  3.8M  106M   4% /boot/efi
2020-11-06T19:56:33.7961811Z Nov 06 19:56:33 /dev/sdb1        15G  4.4G  9.6G  32% /mnt
2020-11-06T19:56:33.7962124Z Nov 06 19:56:33 Allocated ports
2020-11-06T19:56:33.8060627Z Nov 06 19:56:33 Active Internet connections (only servers)
2020-11-06T19:56:33.8061440Z Nov 06 19:56:33 Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
2020-11-06T19:56:33.8062056Z Nov 06 19:56:33 tcp        0      0 127.0.0.1:42609         0.0.0.0:*               LISTEN      1574/containerd
2020-11-06T19:56:33.8062589Z Nov 06 19:56:33 tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      1777/sshd      
2020-11-06T19:56:33.8063102Z Nov 06 19:56:33 tcp6       0      0 :::22                   :::*                    LISTEN      1777/sshd      
2020-11-06T19:56:33.8063617Z Nov 06 19:56:33 udp        0      0 0.0.0.0:68              0.0.0.0:*                           1099/dhclient  
2020-11-06T19:56:33.8069826Z Nov 06 19:56:33 Running docker containers
2020-11-06T19:56:33.8449153Z Nov 06 19:56:33 CONTAINER ID        IMAGE                  COMMAND                  CREATED             STATUS                         PORTS               NAMES
2020-11-06T19:56:33.8451289Z Nov 06 19:56:33 7360a044662a        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_flink-native-k8s-pyflink-application-1-taskmanager-1-1_default_b9fe79cc-84ff-4bae-95a0-6c105d8c6c61_0
2020-11-06T19:56:33.8452835Z Nov 06 19:56:33 691869b9d84e        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_flink-native-k8s-pyflink-application-1-86985776d9-hc7gb_default_446bf0cc-f01c-4b50-97c6-f27ff3ccfc76_0
2020-11-06T19:56:33.8453885Z Nov 06 19:56:33 9f06de0387f8        70f311871ae1           "/coredns -conf /etc…"   About an hour ago   Exited (0) About an hour ago                       k8s_coredns_coredns-6955765f44-zxft7_kube-system_d7bdc27c-2e87-4949-9574-57b80e3b63cc_5
2020-11-06T19:56:33.8454878Z Nov 06 19:56:33 95d3c8c15deb        70f311871ae1           "/coredns -conf /etc…"   About an hour ago   Exited (0) About an hour ago                       k8s_coredns_coredns-6955765f44-c6wlp_kube-system_f7827ddc-2d88-4418-ba7f-aee6802f6528_5
2020-11-06T19:56:33.8455846Z Nov 06 19:56:33 b0e62a8e0c90        ae853e93800d           "/usr/local/bin/kube…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-proxy_kube-proxy-t9q7s_kube-system_c2dc345d-1e68-4470-8f16-879f3fbf5283_5
2020-11-06T19:56:33.8456802Z Nov 06 19:56:33 1a7d4a61653e        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-proxy-t9q7s_kube-system_c2dc345d-1e68-4470-8f16-879f3fbf5283_5
2020-11-06T19:56:33.8457759Z Nov 06 19:56:33 5295ad0ee4f4        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_coredns-6955765f44-zxft7_kube-system_d7bdc27c-2e87-4949-9574-57b80e3b63cc_5
2020-11-06T19:56:33.8458715Z Nov 06 19:56:33 c7776fef7357        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_coredns-6955765f44-c6wlp_kube-system_f7827ddc-2d88-4418-ba7f-aee6802f6528_5
2020-11-06T19:56:33.8459678Z Nov 06 19:56:33 5355d9553f26        4689081edb10           "/storage-provisioner"   About an hour ago   Exited (2) About an hour ago                       k8s_storage-provisioner_storage-provisioner_kube-system_837ab635-4282-4752-a4fa-7901524b86b3_5
2020-11-06T19:56:33.8460651Z Nov 06 19:56:33 b907e7ba51ef        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_storage-provisioner_kube-system_837ab635-4282-4752-a4fa-7901524b86b3_5
2020-11-06T19:56:33.8461628Z Nov 06 19:56:33 a7031f3fd43e        d109c0821a2b           "kube-scheduler --au…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-scheduler_kube-scheduler-fv-az592-353_kube-system_e3025acd90e7465e66fa19c71b916366_5
2020-11-06T19:56:33.8462600Z Nov 06 19:56:33 a18a08c1d08c        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-scheduler-fv-az592-353_kube-system_e3025acd90e7465e66fa19c71b916366_5
2020-11-06T19:56:33.8463569Z Nov 06 19:56:33 8be8abb14306        90d27391b780           "kube-apiserver --ad…"   About an hour ago   Exited (0) About an hour ago                       k8s_kube-apiserver_kube-apiserver-fv-az592-353_kube-system_c0e3f2140f3b15f51d2ef9eb87fb4a1a_5
2020-11-06T19:56:33.8464613Z Nov 06 19:56:33 d4e83c2d976e        b0f1517c1f4b           "kube-controller-man…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-controller-manager_kube-controller-manager-fv-az592-353_kube-system_9a4c117280e4dc00b50f14fa58ce4d1f_5
2020-11-06T19:56:33.8465592Z Nov 06 19:56:33 dacb94c2a315        303ce5db0e90           "etcd --advertise-cl…"   About an hour ago   Exited (0) About an hour ago                       k8s_etcd_etcd-fv-az592-353_kube-system_d459940a27038deee23ff9b7f8ec5cc7_5
2020-11-06T19:56:33.8466561Z Nov 06 19:56:33 d730fc56d8cf        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-controller-manager-fv-az592-353_kube-system_9a4c117280e4dc00b50f14fa58ce4d1f_5
2020-11-06T19:56:33.8467681Z Nov 06 19:56:33 57c53acd6339        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-apiserver-fv-az592-353_kube-system_c0e3f2140f3b15f51d2ef9eb87fb4a1a_5
2020-11-06T19:56:33.8468624Z Nov 06 19:56:33 6252fcbaa447        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_etcd-fv-az592-353_kube-system_d459940a27038deee23ff9b7f8ec5cc7_5
2020-11-06T19:56:33.8469560Z Nov 06 19:56:33 124869bbc5c7        70f311871ae1           "/coredns -conf /etc…"   About an hour ago   Exited (0) About an hour ago                       k8s_coredns_coredns-6955765f44-zxft7_kube-system_d7bdc27c-2e87-4949-9574-57b80e3b63cc_4
2020-11-06T19:56:33.8470535Z Nov 06 19:56:33 0e1b496a027d        70f311871ae1           "/coredns -conf /etc…"   About an hour ago   Exited (0) About an hour ago                       k8s_coredns_coredns-6955765f44-c6wlp_kube-system_f7827ddc-2d88-4418-ba7f-aee6802f6528_4
2020-11-06T19:56:33.8471511Z Nov 06 19:56:33 4f6bdd81ace2        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_coredns-6955765f44-zxft7_kube-system_d7bdc27c-2e87-4949-9574-57b80e3b63cc_4
2020-11-06T19:56:33.8472489Z Nov 06 19:56:33 660581e63ba9        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_coredns-6955765f44-c6wlp_kube-system_f7827ddc-2d88-4418-ba7f-aee6802f6528_4
2020-11-06T19:56:33.8473461Z Nov 06 19:56:33 18f380410438        ae853e93800d           "/usr/local/bin/kube…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-proxy_kube-proxy-t9q7s_kube-system_c2dc345d-1e68-4470-8f16-879f3fbf5283_4
2020-11-06T19:56:33.8474402Z Nov 06 19:56:33 abebbf1b58d7        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-proxy-t9q7s_kube-system_c2dc345d-1e68-4470-8f16-879f3fbf5283_4
2020-11-06T19:56:33.8475366Z Nov 06 19:56:33 00d1e1d5493f        4689081edb10           "/storage-provisioner"   About an hour ago   Exited (2) About an hour ago                       k8s_storage-provisioner_storage-provisioner_kube-system_837ab635-4282-4752-a4fa-7901524b86b3_4
2020-11-06T19:56:33.8476328Z Nov 06 19:56:33 f8daf7dc979b        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_storage-provisioner_kube-system_837ab635-4282-4752-a4fa-7901524b86b3_4
2020-11-06T19:56:33.8477263Z Nov 06 19:56:33 abcd2edb4c51        303ce5db0e90           "etcd --advertise-cl…"   About an hour ago   Exited (0) About an hour ago                       k8s_etcd_etcd-fv-az592-353_kube-system_d459940a27038deee23ff9b7f8ec5cc7_4
2020-11-06T19:56:33.8478243Z Nov 06 19:56:33 4c7d2d45eb3f        b0f1517c1f4b           "kube-controller-man…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-controller-manager_kube-controller-manager-fv-az592-353_kube-system_9a4c117280e4dc00b50f14fa58ce4d1f_4
2020-11-06T19:56:33.8479267Z Nov 06 19:56:33 ac261a730a51        d109c0821a2b           "kube-scheduler --au…"   About an hour ago   Exited (2) About an hour ago                       k8s_kube-scheduler_kube-scheduler-fv-az592-353_kube-system_e3025acd90e7465e66fa19c71b916366_4
2020-11-06T19:56:33.8480265Z Nov 06 19:56:33 fa6769418d3a        90d27391b780           "kube-apiserver --ad…"   About an hour ago   Exited (0) About an hour ago                       k8s_kube-apiserver_kube-apiserver-fv-az592-353_kube-system_c0e3f2140f3b15f51d2ef9eb87fb4a1a_4
2020-11-06T19:56:33.8481196Z Nov 06 19:56:33 882b5b6d1759        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_etcd-fv-az592-353_kube-system_d459940a27038deee23ff9b7f8ec5cc7_4
2020-11-06T19:56:33.8482299Z Nov 06 19:56:33 bda98df17be9        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-scheduler-fv-az592-353_kube-system_e3025acd90e7465e66fa19c71b916366_4
2020-11-06T19:56:33.8504731Z Nov 06 19:56:33 cbe4ff12165e        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-controller-manager-fv-az592-353_kube-system_9a4c117280e4dc00b50f14fa58ce4d1f_4
2020-11-06T19:56:33.8505745Z Nov 06 19:56:33 5889ab63349d        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_kube-apiserver-fv-az592-353_kube-system_c0e3f2140f3b15f51d2ef9eb87fb4a1a_4
2020-11-06T19:56:33.8506740Z Nov 06 19:56:33 34b21e724ea2        72b20d9ad76a           "/docker-entrypoint.…"   About an hour ago   Exited (0) About an hour ago                       k8s_flink-job-cluster_flink-job-cluster-2m9zk_default_5f26e4d8-5d20-44b0-b748-b89e1ba7e96b_0
2020-11-06T19:56:33.8507723Z Nov 06 19:56:33 9ff3a8f4996c        k8s.gcr.io/pause:3.1   "/pause"                 About an hour ago   Exited (0) About an hour ago                       k8s_POD_flink-job-cluster-2m9zk_default_5f26e4d8-5d20-44b0-b748-b89e1ba7e96b_0
2020-11-06T19:56:33.8508147Z Nov 06 19:56:33 ##[endgroup]
2020-11-06T19:56:33.8539998Z cp: cannot stat '/home/vsts/work/1/s/flink-dist/target/flink-1.12-SNAPSHOT-bin/flink-1.12-SNAPSHOT/log/*': No such file or directory
2020-11-06T19:56:33.8544748Z Nov 06 19:56:33 Published e2e logs into debug logs artifact:
2020-11-06T19:56:33.8572467Z Nov 06 19:56:33 Searching for .dump, .dumpstream and related files in '/home/vsts/work/1/s'
2020-11-06T19:56:39.4150274Z Nov 06 19:56:39 COMPRESSING build artifacts.
2020-11-06T19:56:39.4180878Z Nov 06 19:56:39 ./
2020-11-06T19:56:39.4183742Z Nov 06 19:56:39 ./e2e-flink-logs/
2020-11-06T19:56:39.4185971Z Nov 06 19:56:39 ./dmesg.out
2020-11-06T19:56:39.6330306Z Nov 06 19:56:39 No taskexecutor daemon to stop on host fv-az592-353.
2020-11-06T19:56:39.7702995Z Nov 06 19:56:39 No standalonesession daemon to stop on host fv-az592-353.
2020-11-06T19:57:03.0771182Z The STDIO streams did not close within 10 seconds of the exit event from process '/bin/bash'. This may indicate a child process inherited the STDIO streams and has not yet exited.
2020-11-06T19:57:03.0858228Z ##[error]Bash exited with code '1'.
2020-11-06T19:57:08.0909170Z ##[section]Finishing: Run e2e tests
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)