[jira] [Created] (FLINK-3084) File State Backend should not write very small state into files

[Shang Yuanchun (Jira)]

Stephan Ewen created FLINK-3084:
-----------------------------------

             Summary: File State Backend should not write very small state into files
                 Key: FLINK-3084
                 URL: https://issues.apache.org/jira/browse/FLINK-3084
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.10.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.0.0


Currently, the {{FsStateBackend}} writes all state into files. Some state (like Kafka Offsets) is so small that it adds unnecessary overhead, and sometimes the checkpointed file handles are larger than the actual state.

Small state (below a certain threshold, say 1 KB) should not be stored in files, but directly in the state handles.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)