[jira] [Created] (FLINK-13097) Buffer depletion in SimpleCollectingOutputView throws non-obvious EOFException

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13097) Buffer depletion in SimpleCollectingOutputView throws non-obvious EOFException

Shang Yuanchun (Jira)
Cyrille Chépélov created FLINK-13097:
----------------------------------------

             Summary: Buffer depletion in SimpleCollectingOutputView throws non-obvious EOFException
                 Key: FLINK-13097
                 URL: https://issues.apache.org/jira/browse/FLINK-13097
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.8.0, 1.7.2
         Environment: SCIO + BEAM + Flink under scala 2.12, java 8

            Reporter: Cyrille Chépélov


When SimpleCollectingOutputView is used, records are collected into a pre-allocated MemorySegmentSource.

In case of depletion, the SimpleCollectingOutputView#nextSegment method throws EOFException without a message.

This can be non-obvious to diagnose as a newcomer, as
* the Java SDK documentation strongly suggests EOFException is related to an inability to read further (whereas in this context, the exception materializes an inability to _write_ further)
* awareness than pre-allocated, fixed-size buffers are in play may not necessarily be expected of a newcomer to flink.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)