flink performance

[Ufuk Celebi-2]

Hey Norman,

Everything seems to be correct imo. Do the others have any idea?

If you like, we can have a short Skype/Hangout trying to pinpoint the
problem tomorrow. Should be faster than sending mails back in forth. ;)
Afterwards, we would post the result here.

On Tue, Sep 9, 2014 at 10:44 PM, normanSp <[hidden email]>
wrote:

> hi robert,
> no there are no files with hadoop-1.2.1. all files that contain hadoop have
> version 2.4.0.
>
>
>
> --
> View this message in context:
> http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/flink-performance-tp1726p1761.html
> Sent from the Apache Flink (Incubator) Mailing List archive. mailing list
> archive at Nabble.com.
>

[Robert Metzger]

Having a quick call is a good idea. I would also be available for it.

One thing that also came into my mind (I don't think its the case here):
Did you restart flink on the cluster after building the correct version?

On Tue, Sep 9, 2014 at 11:34 PM, Ufuk Celebi <[hidden email]> wrote:

> Hey Norman,
>
> Everything seems to be correct imo. Do the others have any idea?
>
> If you like, we can have a short Skype/Hangout trying to pinpoint the
> problem tomorrow. Should be faster than sending mails back in forth. ;)
> Afterwards, we would post the result here.
>
> On Tue, Sep 9, 2014 at 10:44 PM, normanSp <
> [hidden email]>
> wrote:
>
> > hi robert,
> > no there are no files with hadoop-1.2.1. all files that contain hadoop
> have
> > version 2.4.0.
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/flink-performance-tp1726p1761.html
> > Sent from the Apache Flink (Incubator) Mailing List archive. mailing list
> > archive at Nabble.com.
> >
>

[Robert Metzger]

Hey Norman,

any updates on the issue? I would like to know if there is something wrong
with Flink, because we still could include the fix into the 0.6.1 release.



On Tue, Sep 9, 2014 at 11:39 PM, Robert Metzger <[hidden email]> wrote:

> Having a quick call is a good idea. I would also be available for it.
>
> One thing that also came into my mind (I don't think its the case here):
> Did you restart flink on the cluster after building the correct version?
>
> On Tue, Sep 9, 2014 at 11:34 PM, Ufuk Celebi <[hidden email]> wrote:
>
>> Hey Norman,
>>
>> Everything seems to be correct imo. Do the others have any idea?
>>
>> If you like, we can have a short Skype/Hangout trying to pinpoint the
>> problem tomorrow. Should be faster than sending mails back in forth. ;)
>> Afterwards, we would post the result here.
>>
>> On Tue, Sep 9, 2014 at 10:44 PM, normanSp <
>> [hidden email]>
>> wrote:
>>
>> > hi robert,
>> > no there are no files with hadoop-1.2.1. all files that contain hadoop
>> have
>> > version 2.4.0.
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> >
>> http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/flink-performance-tp1726p1761.html
>> > Sent from the Apache Flink (Incubator) Mailing List archive. mailing
>> list
>> > archive at Nabble.com.
>> >
>>
>
>

[normanSp]

Hey Robert,
sorry for not answering. I decided to rewrite my programs in Java,
because I think there would also other problems when playing around with
the new scala API.
so the problem with HDFS-Files in the scala-rework branch from aljoscha
is still there.

Am 12.09.2014 14:54, schrieb Robert Metzger:

> Hey Norman,
>
> any updates on the issue? I would like to know if there is something wrong
> with Flink, because we still could include the fix into the 0.6.1 release.
>
>
>
> On Tue, Sep 9, 2014 at 11:39 PM, Robert Metzger <[hidden email]> wrote:
>
>> Having a quick call is a good idea. I would also be available for it.
>>
>> One thing that also came into my mind (I don't think its the case here):
>> Did you restart flink on the cluster after building the correct version?
>>
>> On Tue, Sep 9, 2014 at 11:34 PM, Ufuk Celebi <[hidden email]> wrote:
>>
>>> Hey Norman,
>>>
>>> Everything seems to be correct imo. Do the others have any idea?
>>>
>>> If you like, we can have a short Skype/Hangout trying to pinpoint the
>>> problem tomorrow. Should be faster than sending mails back in forth. ;)
>>> Afterwards, we would post the result here.
>>>
>>> On Tue, Sep 9, 2014 at 10:44 PM, normanSp <
>>> [hidden email]>
>>> wrote:
>>>
>>>> hi robert,
>>>> no there are no files with hadoop-1.2.1. all files that contain hadoop
>>> have
>>>> version 2.4.0.
>>>>
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>>
>>> http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/flink-performance-tp1726p1761.html
>>>> Sent from the Apache Flink (Incubator) Mailing List archive. mailing
>>> list
>>>> archive at Nabble.com.
>>>>
>>

[Robert Metzger]

I can not really imagine that the Scala API change causes the issue.
I still believe that somewhere and somehow a old hadoop jar file came into
java's classpath.

On Fri, Sep 12, 2014 at 3:09 PM, Norman Spangenberg <
[hidden email]> wrote:

> Hey Robert,
> sorry for not answering. I decided to rewrite my programs in Java, because
> I think there would also other problems when playing around with the new
> scala API.
> so the problem with HDFS-Files in the scala-rework branch from aljoscha is
> still there.
>
> Am 12.09.2014 14:54, schrieb Robert Metzger:
>
>  Hey Norman,
>>
>> any updates on the issue? I would like to know if there is something wrong
>> with Flink, because we still could include the fix into the 0.6.1 release.
>>
>>
>>
>> On Tue, Sep 9, 2014 at 11:39 PM, Robert Metzger <[hidden email]>
>> wrote:
>>
>>  Having a quick call is a good idea. I would also be available for it.
>>>
>>> One thing that also came into my mind (I don't think its the case here):
>>> Did you restart flink on the cluster after building the correct version?
>>>
>>> On Tue, Sep 9, 2014 at 11:34 PM, Ufuk Celebi <[hidden email]> wrote:
>>>
>>>  Hey Norman,
>>>>
>>>> Everything seems to be correct imo. Do the others have any idea?
>>>>
>>>> If you like, we can have a short Skype/Hangout trying to pinpoint the
>>>> problem tomorrow. Should be faster than sending mails back in forth. ;)
>>>> Afterwards, we would post the result here.
>>>>
>>>> On Tue, Sep 9, 2014 at 10:44 PM, normanSp <
>>>> [hidden email]>
>>>> wrote:
>>>>
>>>>  hi robert,
>>>>> no there are no files with hadoop-1.2.1. all files that contain hadoop
>>>>>
>>>> have
>>>>
>>>>> version 2.4.0.
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>>
>>>>>  http://apache-flink-incubator-mailing-list-archive.1008284.
>>>> n3.nabble.com/flink-performance-tp1726p1761.html
>>>>
>>>>> Sent from the Apache Flink (Incubator) Mailing List archive. mailing
>>>>>
>>>> list
>>>>
>>>>> archive at Nabble.com.
>>>>>
>>>>>
>>>
>

[Robert Metzger]

Hey, I was wrong. It seems that Aljoscha's Scala pull request has issues
with the Hadoop2 version. I think he's going to address the issues.
Let us know if your Java re-implementations are not working on your Hadoop2
cluster (but they should).

On Mon, Sep 15, 2014 at 12:01 PM, Robert Metzger <[hidden email]>
wrote:

> I can not really imagine that the Scala API change causes the issue.
> I still believe that somewhere and somehow a old hadoop jar file came into
> java's classpath.
>
> On Fri, Sep 12, 2014 at 3:09 PM, Norman Spangenberg <
> [hidden email]> wrote:
>
>> Hey Robert,
>> sorry for not answering. I decided to rewrite my programs in Java,
>> because I think there would also other problems when playing around with
>> the new scala API.
>> so the problem with HDFS-Files in the scala-rework branch from aljoscha
>> is still there.
>>
>> Am 12.09.2014 14:54, schrieb Robert Metzger:
>>
>>  Hey Norman,
>>>
>>> any updates on the issue? I would like to know if there is something
>>> wrong
>>> with Flink, because we still could include the fix into the 0.6.1
>>> release.
>>>
>>>
>>>
>>> On Tue, Sep 9, 2014 at 11:39 PM, Robert Metzger <[hidden email]>
>>> wrote:
>>>
>>>  Having a quick call is a good idea. I would also be available for it.
>>>>
>>>> One thing that also came into my mind (I don't think its the case here):
>>>> Did you restart flink on the cluster after building the correct version?
>>>>
>>>> On Tue, Sep 9, 2014 at 11:34 PM, Ufuk Celebi <[hidden email]> wrote:
>>>>
>>>>  Hey Norman,
>>>>>
>>>>> Everything seems to be correct imo. Do the others have any idea?
>>>>>
>>>>> If you like, we can have a short Skype/Hangout trying to pinpoint the
>>>>> problem tomorrow. Should be faster than sending mails back in forth. ;)
>>>>> Afterwards, we would post the result here.
>>>>>
>>>>> On Tue, Sep 9, 2014 at 10:44 PM, normanSp <
>>>>> [hidden email]>
>>>>> wrote:
>>>>>
>>>>>  hi robert,
>>>>>> no there are no files with hadoop-1.2.1. all files that contain hadoop
>>>>>>
>>>>> have
>>>>>
>>>>>> version 2.4.0.
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> View this message in context:
>>>>>>
>>>>>>  http://apache-flink-incubator-mailing-list-archive.1008284.
>>>>> n3.nabble.com/flink-performance-tp1726p1761.html
>>>>>
>>>>>> Sent from the Apache Flink (Incubator) Mailing List archive. mailing
>>>>>>
>>>>> list
>>>>>
>>>>>> archive at Nabble.com.
>>>>>>
>>>>>>
>>>>
>>
>