[DISCUSS] FLIP-109: Improve Hive dependencies out-of-box experience

[Jingsong Lee]

Hi all,

I would like to propose a FLIP[1] that improve hive-integration
dependencies out-of-box experience.
We have discussed in [2].

User can download one single jar to run various versions of hive.

The simple conclusion is:
- Introduce flink-shaded-hive, Provided download URL in flink-web [3]
- One hive bundled version jar to run all supported hive metastore
versions. Other two version jars to support new hive features.
- Pack flink-connector-hive into flink-table-uber-blink
- Hide hiveVersion.

Looking forward to your comments.

[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-109%3A+Improve+Hive+dependencies+out-of-box+experience
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-td35918.html
[3] https://flink.apache.org/downloads.html

Best,
Jingsong Lee

[Jingsong Lee]

Hi all,

After some offline discussion, we have some divergence about using lower
version hive client to support higher version hive server. The question is
whether the lost feature of higher hive version is worth it.

I would like to pause this FLIP, until reach a direct agreement, or one day
we can provide a really convenient hive startup without any setup.

I will continue to improve:
- Hide hive version
- Provide flink-connector-hive-xx module to provide uber jars.

Best,
Jingsong Lee

On Mon, Mar 2, 2020 at 2:31 PM Jingsong Lee <[hidden email]> wrote:

> Hi all,
>
> I would like to propose a FLIP[1] that improve hive-integration
> dependencies out-of-box experience.
> We have discussed in [2].
>
> User can download one single jar to run various versions of hive.
>
> The simple conclusion is:
> - Introduce flink-shaded-hive, Provided download URL in flink-web [3]
> - One hive bundled version jar to run all supported hive metastore
> versions. Other two version jars to support new hive features.
> - Pack flink-connector-hive into flink-table-uber-blink
> - Hide hiveVersion.
>
> Looking forward to your comments.
>
> [1]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-109%3A+Improve+Hive+dependencies+out-of-box+experience
> [2]
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-td35918.html
> [3] https://flink.apache.org/downloads.html
>
> Best,
> Jingsong Lee
>

--
Best, Jingsong Lee