[jira] [Created] (FLINK-19645) ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19645) ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable

Shang Yuanchun (Jira)
Dian Fu created FLINK-19645:
-------------------------------

             Summary: ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable
                 Key: FLINK-19645
                 URL: https://issues.apache.org/jira/browse/FLINK-19645
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
    Affects Versions: 1.12.0
            Reporter: Dian Fu


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7631&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=a99e99c7-21cd-5a1f-7274-585e62b72f56

{code}
2020-10-14T21:46:25.3133019Z [ERROR] testDataCompressionForBlockingShuffle[useBroadcastPartitioner = true](org.apache.flink.test.runtime.ShuffleCompressionITCase)  Time elapsed: 34.949 s  <<< ERROR!
2020-10-14T21:46:25.3133688Z org.apache.flink.util.FlinkException: Could not close resource.
2020-10-14T21:46:25.3134146Z at org.apache.flink.util.AutoCloseableAsync.close(AutoCloseableAsync.java:42)
2020-10-14T21:46:25.3134716Z at org.apache.flink.test.runtime.ShuffleCompressionITCase.executeTest(ShuffleCompressionITCase.java:114)
2020-10-14T21:46:25.3135396Z at org.apache.flink.test.runtime.ShuffleCompressionITCase.testDataCompressionForBlockingShuffle(ShuffleCompressionITCase.java:89)
2020-10-14T21:46:25.3135941Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-10-14T21:46:25.3136410Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-10-14T21:46:25.3136959Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-10-14T21:46:25.3137435Z at java.lang.reflect.Method.invoke(Method.java:498)
2020-10-14T21:46:25.3137915Z at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2020-10-14T21:46:25.3138459Z at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2020-10-14T21:46:25.3138987Z at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2020-10-14T21:46:25.3139524Z at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2020-10-14T21:46:25.3140017Z at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2020-10-14T21:46:25.3140495Z at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2020-10-14T21:46:25.3141037Z at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2020-10-14T21:46:25.3141520Z at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2020-10-14T21:46:25.3142213Z at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2020-10-14T21:46:25.3142672Z at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2020-10-14T21:46:25.3143134Z at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2020-10-14T21:46:25.3143578Z at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2020-10-14T21:46:25.3144026Z at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2020-10-14T21:46:25.3144437Z at org.junit.runners.Suite.runChild(Suite.java:128)
2020-10-14T21:46:25.3144815Z at org.junit.runners.Suite.runChild(Suite.java:27)
2020-10-14T21:46:25.3147907Z at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2020-10-14T21:46:25.3148415Z at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2020-10-14T21:46:25.3149058Z at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2020-10-14T21:46:25.3149526Z at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2020-10-14T21:46:25.3149993Z at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2020-10-14T21:46:25.3150429Z at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2020-10-14T21:46:25.3150918Z at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
2020-10-14T21:46:25.3151469Z at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
2020-10-14T21:46:25.3152045Z at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
2020-10-14T21:46:25.3152599Z at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
2020-10-14T21:46:25.3153163Z at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
2020-10-14T21:46:25.3155116Z at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
2020-10-14T21:46:25.3157282Z at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
2020-10-14T21:46:25.3159466Z at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
2020-10-14T21:46:25.3167068Z Caused by: java.util.concurrent.TimeoutException: Invocation of public abstract java.util.concurrent.CompletableFuture org.apache.flink.runtime.resourcemanager.ResourceManagerGateway.deregisterApplication(org.apache.flink.runtime.clusterframework.ApplicationStatus,java.lang.String) timed out.
2020-10-14T21:46:25.3173751Z at org.apache.flink.runtime.rpc.akka.$Proxy28.deregisterApplication(Unknown Source)
2020-10-14T21:46:25.3371159Z at org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent.deregisterApplication(DispatcherResourceManagerComponent.java:124)
2020-10-14T21:46:25.3372499Z at org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent.lambda$deregisterApplicationAndClose$0(DispatcherResourceManagerComponent.java:111)
2020-10-14T21:46:25.3373451Z at org.apache.flink.runtime.concurrent.FutureUtils.lambda$composeAfterwards$18(FutureUtils.java:598)
2020-10-14T21:46:25.3374185Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3374864Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3375645Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3376288Z at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3376972Z at org.apache.flink.runtime.rest.RestServerEndpoint.lambda$closeAsync$1(RestServerEndpoint.java:306)
2020-10-14T21:46:25.3377646Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3378325Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3379001Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3379643Z at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3380545Z at org.apache.flink.runtime.concurrent.FutureUtils.lambda$null$17(FutureUtils.java:607)
2020-10-14T21:46:25.3381211Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3381884Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3382535Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3383176Z at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3383872Z at org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint.lambda$null$0(DispatcherRestEndpoint.java:153)
2020-10-14T21:46:25.3384683Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3385494Z at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792)
2020-10-14T21:46:25.3386252Z at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153)
2020-10-14T21:46:25.3386984Z at org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint.lambda$shutDownInternal$1(DispatcherRestEndpoint.java:145)
2020-10-14T21:46:25.3387713Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3388371Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3389040Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-10-14T21:46:25.3389677Z at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2020-10-14T21:46:25.3390339Z at org.apache.flink.runtime.concurrent.FutureUtils.lambda$runAfterwardsAsync$16(FutureUtils.java:573)
2020-10-14T21:46:25.3391041Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-10-14T21:46:25.3391789Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-10-14T21:46:25.3392449Z at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
2020-10-14T21:46:25.3392968Z at java.lang.Thread.run(Thread.java:748)
2020-10-14T21:46:25.3394844Z Caused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/rpc/resourcemanager_2#-1642668643]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-10-14T21:46:25.3396483Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-10-14T21:46:25.3396982Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-10-14T21:46:25.3397478Z at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-10-14T21:46:25.3397950Z at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-10-14T21:46:25.3398439Z at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-10-14T21:46:25.3398967Z at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-10-14T21:46:25.3399483Z at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-10-14T21:46:25.3400054Z at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-10-14T21:46:25.3400662Z at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-10-14T21:46:25.3401274Z at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-10-14T21:46:25.3401859Z at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-10-14T21:46:25.3402237Z ... 1 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)