[jira] [Created] (FLINK-8177) Flink cannot be built for Hadoop 2.9.0

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-8177) Flink cannot be built for Hadoop 2.9.0

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-8177:
------------------------------------

             Summary: Flink cannot be built for Hadoop 2.9.0
                 Key: FLINK-8177
                 URL: https://issues.apache.org/jira/browse/FLINK-8177
             Project: Flink
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.4.0, 1.5.0
            Reporter: Fabian Hueske
            Priority: Critical


Flink cannot be built for Hadoop 2.9.0 which was released on Nov. 17th, 2017.

When running

{code}
mvn clean install -DskipTests -Dhadoop.version=2.9.0
{code}

Maven fails with the following error:

{code}
[ERROR] /Users/fhueske/Development/flink/flink-yarn/src/test/java/org/apache/flink/yarn/UtilsTest.java:[239,16] org.apache.flink.yarn.UtilsTest.TestingContainer is not abstract and does not override abstract method setExecutionType(org.apache.hadoop.yarn.api.records.ExecutionType) in org.apache.hadoop.yarn.api.records.Container
{code}

The problem is caused, because Hadoop 2.9.0 extended the {{Container}} interface with a getter ({{getExecutionType()}}) and a setter method ({{setExecutionType()}}) and adds a class dependency on {{ExecutionType}}.

Flink's {{UtilsTest}} class defines a class {{TestingContainer}} that implements the {{Container}} interface.

We cannot simply update the implementation of {{TestingContainer}} because previous versions of Hadoop do not provide {{ExecutionType}}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)