[jira] [Created] (FLINK-18256) Hadoop is bundled in flink-orc exceptionally

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18256) Hadoop is bundled in flink-orc exceptionally

Shang Yuanchun (Jira)
Yang Wang created FLINK-18256:
---------------------------------

             Summary: Hadoop is bundled in flink-orc exceptionally
                 Key: FLINK-18256
                 URL: https://issues.apache.org/jira/browse/FLINK-18256
             Project: Flink
          Issue Type: Bug
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
    Affects Versions: 1.11.0, 1.12.0
            Reporter: Yang Wang
             Fix For: 1.11.0, 1.12.0


The {{hadoop-common}} and {{hadoop-hdfs}} have been bundled into the {{flink-orc_2.11-1.11-SNAPSHOT-jar-with-dependencies.jar}}. Since we suggest our users to put this jar into lib directory or add dependency in their pom to build fat jar, it might be incorrect to have hadoop here. Flink now is not hadoop free, we have some specific hadoop version classes in the released jars.

 

> How to fix?

Let flink-orc depends on {{hadoop-common}} and {{hadoop-hdfs}} directly and make them provided.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)