[jira] [Created] (FLINK-3956) Make FileInputFormats in Streaming independent from the Configuration object

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3956) Make FileInputFormats in Streaming independent from the Configuration object

Shang Yuanchun (Jira)
Kostas Kloudas created FLINK-3956:
-------------------------------------

             Summary: Make FileInputFormats in Streaming independent from the Configuration object
                 Key: FLINK-3956
                 URL: https://issues.apache.org/jira/browse/FLINK-3956
             Project: Flink
          Issue Type: Bug
          Components: Streaming
            Reporter: Kostas Kloudas
            Assignee: Kostas Kloudas


Currently many input file input formats rely on a user specified Configuration object for their correct configuration. As an example, the DelimitedInputFormat can take its delimiter character from this object.

This is happening for legacy reasons, and does not work in the streaming codebase. In streaming, the user-specified configuration object is over-written at the TaskManagers by a new Configuration object.

This issue aims at solving this by refactoring current file input formats to be
able to set their parameters through setters.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)