[jira] [Created] (FLINK-17865) Increase default size of `state.backend.fs.memory-threshold`

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17865) Increase default size of `state.backend.fs.memory-threshold`

Shang Yuanchun (Jira)
Yu Li created FLINK-17865:
-----------------------------

             Summary: Increase default size of `state.backend.fs.memory-threshold`
                 Key: FLINK-17865
                 URL: https://issues.apache.org/jira/browse/FLINK-17865
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / State Backends
    Affects Versions: 1.11.0
            Reporter: Yu Li
            Assignee: Yun Tang
             Fix For: 1.11.0


As discussed in [ML thread|https://s.apache.org/us0en], we decided to increase the default value of `state.backend.fs.memory-threshold` from 1K to *20K* to prevent too many small files created on remote FS.

We need to add an explicit release note to notify our users about this change, especially for those having jobs with large parallelism on source or stateful operators.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)