[jira] [Created] (FLINK-18013) Refactor Hadoop Utility classes/functions into a common Maven module

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18013) Refactor Hadoop Utility classes/functions into a common Maven module

Shang Yuanchun (Jira)
Sivaprasanna Sethuraman created FLINK-18013:
-----------------------------------------------

             Summary: Refactor Hadoop Utility classes/functions into a common Maven module
                 Key: FLINK-18013
                 URL: https://issues.apache.org/jira/browse/FLINK-18013
             Project: Flink
          Issue Type: Improvement
            Reporter: Sivaprasanna Sethuraman


We have multiple modules which use Hadoop in one way another. This has caused a significant redundancy in utility classes and functions related to Hadoop. One such example which is also the motivation behind this Jira is the functionality to (de)serializing Hadoop Configuration. This functionality has multiple implementations across multiple modules (flink-hadoop-fs, flink-orc, flink-sequence-file, etc) with more or less the same code.

The aim of this Jira is to introduce a new module, say flink-hadoop-utils, that only contains the Hadoop related utility classes & functions with proper test cases in a single shareable module and get rid of the redundancy by adding this module as the dependency.

Relevant [DISCUSS] thread can be found at [https://lists.apache.org/thread.html/rf885987160bede5911a7f61923307a6d5ae07f850da0a90555728e5f%40%3Cdev.flink.apache.org%3E]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)