[jira] [Created] (FLINK-11470) LocalEnvironment doesn't call FileSystem.initialize()

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11470) LocalEnvironment doesn't call FileSystem.initialize()

Shang Yuanchun (Jira)
Nico Kruber created FLINK-11470:
-----------------------------------

             Summary: LocalEnvironment doesn't call FileSystem.initialize()
                 Key: FLINK-11470
                 URL: https://issues.apache.org/jira/browse/FLINK-11470
             Project: Flink
          Issue Type: Bug
          Components: Local Runtime
    Affects Versions: 1.6.2
            Reporter: Nico Kruber


Proper Flink cluster components, e.g. task manager or job manager, initialize configured file systems with their parsed {{Configuration}} objects. However, the {{LocalEnvironment}} does not seem to do that and we therefore lack the ability to configure access credentials etc like in the following example:
{code}
        Configuration config = new Configuration();
        config.setString("s3.access-key", "user");
        config.setString("s3.secret-key", "secret");
//        FileSystem.initialize(config);
        final ExecutionEnvironment exEnv = ExecutionEnvironment.createLocalEnvironment(config);
{code}

The workaround is to call {{FileSystem.initialize(config);}} yourself but it is actually surprising that this is not done automatically.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)