[jira] [Created] (FLINK-20292) Avro format conflicts with Parquet and Orc

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20292) Avro format conflicts with Parquet and Orc

Shang Yuanchun (Jira)
Yun Gao created FLINK-20292:
-------------------------------

             Summary: Avro format conflicts with Parquet and Orc
                 Key: FLINK-20292
                 URL: https://issues.apache.org/jira/browse/FLINK-20292
             Project: Flink
          Issue Type: Bug
            Reporter: Yun Gao
             Fix For: 1.12.0


When testing the Flink 1.12 in a standalone mode cluster, I found that if the user job jar contains both _flink-avro_  and _flink-parquet/flink-orc_, the FileSystemTableSink would not be able to load the corresponding format factory correctly. But if only one format is dependent it works.

The test project located in [here|https://github.com/gaoyunhaii/flink1.12test] and the test class is [FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java].

The conflict does not seem to affect the local runner, but only has problem when submitted to the standalone cluster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)