GitHub user atsikiridis opened a pull request:
https://github.com/apache/incubator-flink/pull/37 hadoopcompatibility: Implementations of basic programming interfaces and... ... a basic driver. * wrappers for Mapper, Reducer and Combiner (as a local Reducer) on the new Java API * wrapper for OutputCollector * wrappers for Partitioner, values comparator. * a driver making it posible to run unmonitored (so far) Hadoop jobs on Flink. * tests and variations of the WordCount driver exclusively in Hadoop. You can find more about the project here: https://issues.apache.org/jira/browse/FLINK-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031511 You can merge this pull request into a Git repository by running: $ git pull https://github.com/atsikiridis/incubator-flink gsoc-midterm Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-flink/pull/37.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #37 ---- commit 6aaccc71910074c3130228a7855d25cfcfce3e82 Author: Artem Tsikiridis <[hidden email]> Date: 2014-05-13T19:31:13Z hadoopcompatibility: Implementations of basic programming interfaces and a basic driver. * wrappers for Mapper, Reducer and Combiner (as a local Reducer) on the new Java API * wrapper for OutputCollector * wrappers for Partitioner, values comparator. * a driver making it posible to run unmonitored (so far) Hadoop jobs on Flink. * tests and variations of the WordCount driver exclusively in Hadoop. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at [hidden email] or file a JIRA ticket with INFRA. --- |
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47066734 Thank you for the pull request. I know it was a lot of work. It fails to build with hadoop 2.2.0 dependencies: https://travis-ci.org/apache/incubator-flink/builds/28311858 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at [hidden email] or file a JIRA ticket with INFRA. --- |
In reply to this post by zentol
Github user atsikiridis commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47141587 Hey @rmetzger I think I made a fix for hadoop 2.2.0 dependencies. But I'm not sure I understand why it is still failing. Can you take a look please? :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at [hidden email] or file a JIRA ticket with INFRA. --- |
In reply to this post by zentol
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47146152 Hey, everything is okay now, according to this page: https://travis-ci.org/apache/incubator-flink/builds/28399204 (You can ignore the one failed build, its not your fault). So travis gave its okay to your pull request. Now we have to wait until somebody finds time to test the pull request. @twalthr: you do have time for that? I think we have to write a little map-reduce example and run it on our cluster. The test should verify that everything is intuitive, well documented .. and that it runs on the cluster. We could also try to run a Mahout (map reduce) algorithm from Stratosphere. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at [hidden email] or file a JIRA ticket with INFRA. --- |
In reply to this post by zentol
Github user twalthr commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47162498 I don't think that I can review and test it this week. But next week would be possible. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at [hidden email] or file a JIRA ticket with INFRA. --- |
Free forum by Nabble | Edit this page |