Hello! My streaming job periodically checkpoints state to S3. While the
checkpointing itself works fine, I do see this log message each time its
triggered and am curious whether there's anything we can do about it.
2020-08-21 08:32:38,031 INFO
org.apache.flink.fs.s3base.shaded.com.amazonaws.latency -
ServiceName=[Amazon S3], AWSErrorCode=[404 Not Found], StatusCode=[404],
ServiceEndpoint=[BUCKET_URL],
Exception=[org.apache.flink.fs.s3base.shaded.com.amazonaws.services.s3.model.AmazonS3Exception:
Not Found (Service: Amazon S3; Status Code: 404; Error Code: 404 Not Found;
Request ID: XXX; S3 Extended Request ID: YYY=), S3 Extended Request ID:
YYY=], RequestType=[GetObjectMetadataRequest], AWSRequestID=[XXX],
HttpClientPoolPendingCount=0, RetryCapacityConsumed=0,
HttpClientPoolAvailableCount=1, RequestCount=1, Exception=1,
HttpClientPoolLeasedCount=0, ClientExecuteTime=[10.511],
HttpClientSendRequestTime=[0.06], HttpRequestTime=[10.244],
RequestSigningTime=[0.073], CredentialsRequestTime=[0.001, 0.0],
HttpClientReceiveResponseTime=[10.067],
Can this error be resolved by enabling consisten view in s3
<
https://docs.aws.amazon.com/emr/latest/ManagementGuide/enable-consistent-view.html>
? I also see this error occasionally:
2020-08-21 08:36:06,008 WARN
org.apache.flink.fs.s3base.shaded.com.amazonaws.services.s3.internal.Mimetypes
- Unable to find 'mime.types' file in classpath
Can anything be done about it?
--
Sent from:
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/