[jira] [Created] (FLINK-13850) Refactor part file configuration into a single method

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13850) Refactor part file configuration into a single method

Shang Yuanchun (Jira)
Gyula Fora created FLINK-13850:
----------------------------------

             Summary: Refactor part file configuration into a single method
                 Key: FLINK-13850
                 URL: https://issues.apache.org/jira/browse/FLINK-13850
             Project: Flink
          Issue Type: Sub-task
          Components: Connectors / FileSystem
            Reporter: Gyula Fora
             Fix For: 1.10.0


Currently there is only two methods on both format builders
withPartFilePrefix and withPartFileSuffix for configuring the part files but in the future it is likely to grow.
 * More settings, different directories for pending / inprogress files etc

I suggest we remove these two methods and replace them with a single : withPartFileConfig(..) where we use an extensible config class.

This should be fixed before 1.10 in order to not release the other methods.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)