[jira] [Created] (FLINK-2748) Accumulator fetch failure leads to duplicate job result response

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2748) Accumulator fetch failure leads to duplicate job result response

Shang Yuanchun (Jira)
Ufuk Celebi created FLINK-2748:
----------------------------------

             Summary: Accumulator fetch failure leads to duplicate job result response
                 Key: FLINK-2748
                 URL: https://issues.apache.org/jira/browse/FLINK-2748
             Project: Flink
          Issue Type: Bug
          Components: JobManager
    Affects Versions: master
            Reporter: Ufuk Celebi


On {{JobStatusChanged}} message and a failure to catch the accumulator result the client will receive a {{JobResultFailure}} and {{JobResultSuccess}} response

{code}
newJobStatus match {
  case JobStatus.FINISHED =>
    val accumulatorResults: java.util.Map[String, SerializedValue[AnyRef]] = try {
      executionGraph.getAccumulatorsSerialized()
    } catch {
      case e: Exception =>
        log.error(s"Cannot fetch final accumulators for job $jobID", e)
        val exception = new JobExecutionException(jobID,
          "Failed to retrieve accumulator results.", e)
        jobInfo.client ! decorateMessage(JobResultFailure(
          new SerializedThrowable(exception)))
        Collections.emptyMap()  <<< HERE
    }
  val result = new SerializedJobExecutionResult(
    jobID,
    jobInfo.duration,
    accumulatorResults)
    jobInfo.client ! decorateMessage(JobResultSuccess(result)) <<< HERE
{code}

Furthermore the indentation is off.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)