[jira] [Created] (FLINK-14569) use flink to deal with batch task,when parallelism granter than 1, always 1 or 2 records loss

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14569) use flink to deal with batch task,when parallelism granter than 1, always 1 or 2 records loss

Shang Yuanchun (Jira)
kk created FLINK-14569:
--------------------------

             Summary: use flink to deal with batch task,when parallelism granter than 1, always 1 or 2 records loss
                 Key: FLINK-14569
                 URL: https://issues.apache.org/jira/browse/FLINK-14569
             Project: Flink
          Issue Type: Bug
          Components: API / DataSet
    Affects Versions: 1.7.2
         Environment: hadoop:2.8.5

flink: 1.7.1

node machines: 3

deploy: yarn
            Reporter: kk


when flink read from hdfs file and set the parallelism>1, occasionally, 1  or 2 records  lose,  however the hdfs file bigger or smaller.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)