[jira] [Created] (FLINK-7767) Avoid loading Hadoop conf dynamically at runtime

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-7767) Avoid loading Hadoop conf dynamically at runtime

Shang Yuanchun (Jira)
Stephan Ewen created FLINK-7767:
-----------------------------------

             Summary: Avoid loading Hadoop conf dynamically at runtime
                 Key: FLINK-7767
                 URL: https://issues.apache.org/jira/browse/FLINK-7767
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.4.0


The bucketing sink dynamically loads the Hadoop configuration in various places.

The result of that configuration is not always predictable, as it tries to automagically discover the Hadoop config files.

A better approach is to rely on the Flink configuration to find the Hadoop configuration, or to directly use the Hadoop configuration used by the Hadoop file systems.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)