[jira] [Created] (FLINK-13889) sql client fetch result oom

[Shang Yuanchun (Jira)]

richt richt created FLINK-13889:
-----------------------------------

             Summary: sql client fetch result oom
                 Key: FLINK-13889
                 URL: https://issues.apache.org/jira/browse/FLINK-13889
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / Client
    Affects Versions: 1.8.1
            Reporter: richt richt


i submit sql by sql-client to flink on yarn .

in the flink dashboard , it said the job is finished ,

but the client get this error
{code:java}
//代码占位符
[ERROR] Could not execute SQL statement. Reason:[ERROR] Could not execute SQL statement. Reason:org.apache.flink.runtime.rest.util.RestClientException: [Internal server error., <Exception on server side:java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3332) at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124) at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:596) at java.lang.StringBuffer.append(StringBuffer.java:367) at java.io.StringWriter.write(StringWriter.java:94) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._flushBuffer(WriterBasedJsonGenerator.java:1946) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._writeBinary(WriterBasedJsonGenerator.java:1485) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator.writeBinary(WriterBasedJsonGenerator.java:602) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator.writeBinary(JsonGenerator.java:1163) at org.apache.flink.runtime.rest.messages.json.SerializedValueSerializer.serialize(SerializedValueSerializer.java:54) at org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:92) at org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:41) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:727) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:719) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:155) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._configAndWriteValue(ObjectMapper.java:3905) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3201) at org.apache.flink.runtime.rest.handler.util.HandlerUtils.sendResponse(HandlerUtils.java:81) at org.apache.flink.runtime.rest.handler.AbstractRestHandler.lambda$respondToRequest$0(AbstractRestHandler.java:78) at org.apache.flink.runtime.rest.handler.AbstractRestHandler$$Lambda$119/1537887475.accept(Unknown Source) at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:656) at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:632) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:821) at akka.dispatch.OnComplete.internal(Future.scala:264) at akka.dispatch.OnComplete.internal(Future.scala:261) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:191) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:188) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) End of exception on server side>]
{code}
 

And yarn web ui i got message as below
{code:java}
//代码占位符
 ERROR org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler  - Unhandled exception. ERROR org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler  - Unhandled exception.java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3332) at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124) at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:596) at java.lang.StringBuffer.append(StringBuffer.java:367) at java.io.StringWriter.write(StringWriter.java:94) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._flushBuffer(WriterBasedJsonGenerator.java:1946) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator._writeBinary(WriterBasedJsonGenerator.java:1485) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.json.WriterBasedJsonGenerator.writeBinary(WriterBasedJsonGenerator.java:602) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator.writeBinary(JsonGenerator.java:1163) at org.apache.flink.runtime.rest.messages.json.SerializedValueSerializer.serialize(SerializedValueSerializer.java:54) at org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:92) at org.apache.flink.runtime.rest.messages.json.JobResultSerializer.serialize(JobResultSerializer.java:41) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:727) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:719) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:155) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._configAndWriteValue(ObjectMapper.java:3905) at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3201) at org.apache.flink.runtime.rest.handler.util.HandlerUtils.sendResponse(HandlerUtils.java:81) at org.apache.flink.runtime.rest.handler.AbstractRestHandler.lambda$respondToRequest$0(AbstractRestHandler.java:78) at org.apache.flink.runtime.rest.handler.AbstractRestHandler$$Lambda$119/1537887475.accept(Unknown Source) at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:656) at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:632) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:821) at akka.dispatch.OnComplete.internal(Future.scala:264) at akka.dispatch.OnComplete.internal(Future.scala:261) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:191) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:188) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
{code}
i tried  some parameter below 

./bin/yarn-session.sh -s 4 --container 64 -tm 8024m -m 12000m -yjm12100m -m5096

sql client parameter max-table-result-rows

and they seem dose not work.

how to trace the error  with flink on yarn , how to find the  container log for flink ?

 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)