[jira] [Created] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

Shang Yuanchun (Jira)
Nico Kruber created FLINK-8755:
----------------------------------

             Summary: SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available
                 Key: FLINK-8755
                 URL: https://issues.apache.org/jira/browse/FLINK-8755
             Project: Flink
          Issue Type: Sub-task
          Components: Network
            Reporter: Nico Kruber
            Assignee: Nico Kruber
             Fix For: 1.5.0


{code}
public BufferAndBacklog getNextBuffer() throws IOException, InterruptedException {
//...
        int newBacklog = parent.decreaseBuffersInBacklog(current);
        return new BufferAndBacklog(current, newBacklog > 0, newBacklog, nextBufferIsEvent);
{code}
relies on the backlog to signal further data availability. However, if there are only events left in the buffer queue, their buffers are not included in the backlog counting and therefore, {{isMoreAvailable}} will be wrongly {{false}} here.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)