[jira] [Created] (FLINK-1296) Add support for very large record for sorting

[Shang Yuanchun (Jira)]

Stephan Ewen created FLINK-1296:
-----------------------------------

             Summary: Add support for very large record for sorting
                 Key: FLINK-1296
                 URL: https://issues.apache.org/jira/browse/FLINK-1296
             Project: Flink
          Issue Type: Bug
          Components: Local Runtime
    Affects Versions: 0.8-incubating
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 0.8-incubating


Currently, very large records (multiple hundreds of megabytes) can break the sorter if the overflow the sort buffer.

Furthermore, if a merge is attempted of those records, pulling multiple of them concurrently into memory can break the machine memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)