[GitHub] incubator-flink pull request: hadoopcompatibility: Implementations...

[zentol]

GitHub user atsikiridis opened a pull request:

    https://github.com/apache/incubator-flink/pull/37

    hadoopcompatibility: Implementations of basic programming interfaces and...

    ... a basic driver.
   
    * wrappers for Mapper, Reducer and Combiner (as a local Reducer) on the new Java API
    * wrapper for OutputCollector
    * wrappers for Partitioner, values comparator.
    * a driver making it posible to run unmonitored (so far)  Hadoop jobs on Flink.
    * tests and variations of the WordCount driver exclusively in Hadoop.
   
    You can find more about the project here:  https://issues.apache.org/jira/browse/FLINK-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031511

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/atsikiridis/incubator-flink gsoc-midterm

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-flink/pull/37.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #37
   
----
commit 6aaccc71910074c3130228a7855d25cfcfce3e82
Author: Artem Tsikiridis <[hidden email]>
Date:   2014-05-13T19:31:13Z

    hadoopcompatibility: Implementations of basic programming interfaces and a basic driver.
   
    * wrappers for Mapper, Reducer and Combiner (as a local Reducer) on the new Java API
    * wrapper for OutputCollector
    * wrappers for Partitioner, values comparator.
    * a driver making it posible to run unmonitored (so far)  Hadoop jobs on Flink.
    * tests and variations of the WordCount driver exclusively in Hadoop.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---

[zentol]

Github user rmetzger commented on the pull request:

    https://github.com/apache/incubator-flink/pull/37#issuecomment-47066734
 
    Thank you for the pull request. I know it was a lot of work.
    It fails to build with hadoop 2.2.0 dependencies: https://travis-ci.org/apache/incubator-flink/builds/28311858


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---

[zentol]

Github user atsikiridis commented on the pull request:

    https://github.com/apache/incubator-flink/pull/37#issuecomment-47141587
 
    Hey @rmetzger I think I made a fix for hadoop 2.2.0 dependencies. But I'm not sure I understand why it is still failing. Can you take a look please? :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---

[zentol]

Github user rmetzger commented on the pull request:

    https://github.com/apache/incubator-flink/pull/37#issuecomment-47146152
 
    Hey, everything is okay now, according to this page: https://travis-ci.org/apache/incubator-flink/builds/28399204 (You can ignore the one failed build, its not your fault).
    So travis gave its okay to your pull request.
    Now we have to wait until somebody finds time to test the pull request.
    @twalthr: you do have time for that? I think we have to write a little map-reduce example and run it on our cluster. The test should verify that everything is intuitive, well documented .. and that it runs on the cluster. We could also try to run a Mahout (map reduce) algorithm from Stratosphere.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---

[zentol]

Github user twalthr commented on the pull request:

    https://github.com/apache/incubator-flink/pull/37#issuecomment-47162498
 
    I don't think that I can review and test it this week. But next week would be possible.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---