[jira] [Created] (FLINK-1359) Make IntermediateResultPartitionManager aware of consumed partitions

[Shang Yuanchun (Jira)]

Ufuk Celebi created FLINK-1359:
----------------------------------

             Summary: Make IntermediateResultPartitionManager aware of consumed partitions
                 Key: FLINK-1359
                 URL: https://issues.apache.org/jira/browse/FLINK-1359
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi


The current state of runtime support for intermediate results (see https://github.com/apache/incubator-flink/pull/254 and FLINK-986) does not distinguish between historic and currently produced/consumed intermediate result partitions (e.g. only non-persistent intermediate results) in the intermediate result partition manager.

For persistent intermediate results we need to distinguish between currently consumed results and those that have already been produced and consumed. As a first step, historic results can be evicted based on least recent use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)