Robert Metzger created FLINK-1065:
-------------------------------------
Summary: "flink-streaming-core" build fails with Hadoop 2.4.0 dependencies
Key: FLINK-1065
URL:
https://issues.apache.org/jira/browse/FLINK-1065 Project: Flink
Issue Type: Bug
Components: Streaming
Affects Versions: 0.7-incubating
Reporter: Robert Metzger
Hi,
building Flink with "mvn clean package -Dhadoop.profile=2 -DskipTests -Dhadoop-two.version=2.4.0"
results in the following error
{code}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project flink-streaming-core: Compilation failure: Compilation failure:
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/BatchReduceInvokable.java:[22,36] package org.apache.commons.math.util does not exist
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/WindowReduceInvokable.java:[22,36] package org.apache.commons.math.util does not exist
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/BatchReduceInvokable.java:[39,36] cannot find symbol
[ERROR] symbol: variable MathUtils
[ERROR] location: class org.apache.flink.streaming.api.invokable.operator.BatchReduceInvokable<IN,OUT>
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/BatchReduceInvokable.java:[48,36] cannot find symbol
[ERROR] symbol: variable MathUtils
[ERROR] location: class org.apache.flink.streaming.api.invokable.operator.BatchReduceInvokable<IN,OUT>
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/WindowReduceInvokable.java:[40,36] cannot find symbol
[ERROR] symbol: variable MathUtils
[ERROR] location: class org.apache.flink.streaming.api.invokable.operator.WindowReduceInvokable<IN,OUT>
[ERROR] /home/robert/incubator-flink/flink-addons/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/invokable/operator/WindowReduceInvokable.java:[49,36] cannot find symbol
[ERROR] symbol: variable MathUtils
[ERROR] location: class org.apache.flink.streaming.api.invokable.operator.WindowReduceInvokable<IN,OUT>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :flink-streaming-core
{code}
I think older Hadoop versions (its working with Hadoop 2.2.0) are pulling in transitive dependencies that are not present with Hadoop 2.4.0 anymore.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Locked
