Building Flink for Hadoop 2

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Building Flink for Hadoop 2

Henry Saputra
HI All,

I just realized that to build Flink for Hadoop 2 I could no longer run this:

  mvn clean package -DskipTests -Dhadoop.profile=2

it barfed with error:

[INFO] Scanning for projects...
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project
org.apache.flink:flink-hbase:0.9-incubating-SNAPSHOT
(/home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml)
has 1 error
[ERROR]     'dependencies.dependency.version' for
org.apache.hbase:hbase-client:jar must be a valid version but is
'${hbase.version}'. @ org.apache.flink:flink-hbase:[unknown-version],
/home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml,
line 77, column 13
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException

I now have to do run 'mvn clean package -DskipTests -Phadoop-2'
command to set the hbase-version properly and pull the right
dependencies.

Was there any major Maven pom.xml updates?

- Henry
Reply | Threaded
Open this post in threaded view
|

Re: Building Flink for Hadoop 2

Chiwan Park
Hi.

After 0.8-incubating, the default profile of hadoop is 2. (https://issues.apache.org/jira/browse/FLINK-1234 <https://issues.apache.org/jira/browse/FLINK-1234>)
So, you don’t need to set hadoop 2 profile to build Flink for hadoop 2.
I tested with `mvn clean package -DskipTests` and the build result is success.


Chiwan Park (Sent with iPhone)



> On Dec 17, 2014, at 2:15 PM, Henry Saputra <[hidden email]> wrote:
>
> HI All,
>
> I just realized that to build Flink for Hadoop 2 I could no longer run this:
>
>  mvn clean package -DskipTests -Dhadoop.profile=2
>
> it barfed with error:
>
> [INFO] Scanning for projects...
> [ERROR] The build could not read 1 project -> [Help 1]
> [ERROR]
> [ERROR]   The project
> org.apache.flink:flink-hbase:0.9-incubating-SNAPSHOT
> (/home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml)
> has 1 error
> [ERROR]     'dependencies.dependency.version' for
> org.apache.hbase:hbase-client:jar must be a valid version but is
> '${hbase.version}'. @ org.apache.flink:flink-hbase:[unknown-version],
> /home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml,
> line 77, column 13
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
> I now have to do run 'mvn clean package -DskipTests -Phadoop-2'
> command to set the hbase-version properly and pull the right
> dependencies.
>
> Was there any major Maven pom.xml updates?
>
> - Henry

Reply | Threaded
Open this post in threaded view
|

Re: Building Flink for Hadoop 2

Henry Saputra
Ah yes, I vague remember that patch. Thanks for the reminder.

- Henry

On Tue, Dec 16, 2014 at 10:24 PM, Chiwan Park <[hidden email]> wrote:

> Hi.
>
> After 0.8-incubating, the default profile of hadoop is 2. (https://issues.apache.org/jira/browse/FLINK-1234 <https://issues.apache.org/jira/browse/FLINK-1234>)
> So, you don’t need to set hadoop 2 profile to build Flink for hadoop 2.
> I tested with `mvn clean package -DskipTests` and the build result is success.
>
> —
> Chiwan Park (Sent with iPhone)
>
>
>
>> On Dec 17, 2014, at 2:15 PM, Henry Saputra <[hidden email]> wrote:
>>
>> HI All,
>>
>> I just realized that to build Flink for Hadoop 2 I could no longer run this:
>>
>>  mvn clean package -DskipTests -Dhadoop.profile=2
>>
>> it barfed with error:
>>
>> [INFO] Scanning for projects...
>> [ERROR] The build could not read 1 project -> [Help 1]
>> [ERROR]
>> [ERROR]   The project
>> org.apache.flink:flink-hbase:0.9-incubating-SNAPSHOT
>> (/home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml)
>> has 1 error
>> [ERROR]     'dependencies.dependency.version' for
>> org.apache.hbase:hbase-client:jar must be a valid version but is
>> '${hbase.version}'. @ org.apache.flink:flink-hbase:[unknown-version],
>> /home/hsaputra/open/hsaputra/incubator-flink/flink-addons/flink-hbase/pom.xml,
>> line 77, column 13
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>> the -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>>
>> I now have to do run 'mvn clean package -DskipTests -Phadoop-2'
>> command to set the hbase-version properly and pull the right
>> dependencies.
>>
>> Was there any major Maven pom.xml updates?
>>
>> - Henry
>