YARN ITCases fail, master broken?

classic Classic list List threaded Threaded
19 messages Options
Reply | Threaded
Open this post in threaded view
|

YARN ITCases fail, master broken?

Fabian Hueske-2
Hi all,

I tried to build the current master (mvn clean install) and some tests in
the flink-yarn-tests module fail:

Failed tests:


YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
During the timeout period of 60 seconds the expected string did not show up

  YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
There is at least one application on the cluster is not finished

  YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
During the timeout period of 60 seconds the expected string did not show up

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished

  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
least one application on the cluster is not finished


Tests run: 10, Failures: 10, Errors: 0, Skipped: 0

Anybody else got this problem?

Cheers, Fabian
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Henry Saputra
Did not see that trace but do see this:

-------------------------------------------------------

 T E S T S

-------------------------------------------------------

Running org.apache.flink.yarn.UtilsTest

log4j:WARN No such property [append] in org.apache.log4j.ConsoleAppender.

Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.476
sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest

testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
0.405 sec  <<< FAILURE!

java.lang.AssertionError: null

at org.junit.Assert.fail(Assert.java:86)

at org.junit.Assert.assertTrue(Assert.java:41)

at org.junit.Assert.assertNotNull(Assert.java:621)

at org.junit.Assert.assertNotNull(Assert.java:631)

at org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)



Results :


Failed tests:

  UtilsTest.testUberjarLocator:32 null


Tests run: 1, Failures: 1, Errors: 0, Skipped: 0


- Henry

On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]> wrote:

> Hi all,
>
> I tried to build the current master (mvn clean install) and some tests in
> the flink-yarn-tests module fail:
>
> Failed tests:
>
>
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> During the timeout period of 60 seconds the expected string did not show up
>
>   YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> There is at least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> During the timeout period of 60 seconds the expected string did not show up
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> least one application on the cluster is not finished
>
>
> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
>
> Anybody else got this problem?
>
> Cheers, Fabian
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Henry Saputra
Hmm, I think there could be some weird dependencies to get the Flink
YARN uber jar.

If you do "mvn clean install -DskipTests" then call "mvn test" all the
tests passed.

But if you directly call "mvn clean test" then you see the stack I
have seen before.

- Henry


On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <[hidden email]> wrote:

> Did not see that trace but do see this:
>
> -------------------------------------------------------
>
>  T E S T S
>
> -------------------------------------------------------
>
> Running org.apache.flink.yarn.UtilsTest
>
> log4j:WARN No such property [append] in org.apache.log4j.ConsoleAppender.
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.476
> sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
>
> testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
> 0.405 sec  <<< FAILURE!
>
> java.lang.AssertionError: null
>
> at org.junit.Assert.fail(Assert.java:86)
>
> at org.junit.Assert.assertTrue(Assert.java:41)
>
> at org.junit.Assert.assertNotNull(Assert.java:621)
>
> at org.junit.Assert.assertNotNull(Assert.java:631)
>
> at org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
>
>
>
> Results :
>
>
> Failed tests:
>
>   UtilsTest.testUberjarLocator:32 null
>
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
>
>
> - Henry
>
> On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]> wrote:
>> Hi all,
>>
>> I tried to build the current master (mvn clean install) and some tests in
>> the flink-yarn-tests module fail:
>>
>> Failed tests:
>>
>>
>> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
>> During the timeout period of 60 seconds the expected string did not show up
>>
>>   YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
>> There is at least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
>> During the timeout period of 60 seconds the expected string did not show up
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
>> least one application on the cluster is not finished
>>
>>
>> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
>>
>> Anybody else got this problem?
>>
>> Cheers, Fabian
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
Hi Henry,

running "mvn -DskipTests clean install" before "mvn clean install" did not
fix the build for me.
The failing tests are also integration tests (*ITCase) which are only
executed in Maven's verify phase which is not triggered if you run "mvn
clean test".
If I run "mvn test" without "mvn install" it fails for me as well with the
error you posted.

So there seem to be at least two build issues with the current master.

2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:

> Hmm, I think there could be some weird dependencies to get the Flink
> YARN uber jar.
>
> If you do "mvn clean install -DskipTests" then call "mvn test" all the
> tests passed.
>
> But if you directly call "mvn clean test" then you see the stack I
> have seen before.
>
> - Henry
>
>
> On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <[hidden email]>
> wrote:
> > Did not see that trace but do see this:
> >
> > -------------------------------------------------------
> >
> >  T E S T S
> >
> > -------------------------------------------------------
> >
> > Running org.apache.flink.yarn.UtilsTest
> >
> > log4j:WARN No such property [append] in org.apache.log4j.ConsoleAppender.
> >
> > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.476
> > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> >
> > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
> > 0.405 sec  <<< FAILURE!
> >
> > java.lang.AssertionError: null
> >
> > at org.junit.Assert.fail(Assert.java:86)
> >
> > at org.junit.Assert.assertTrue(Assert.java:41)
> >
> > at org.junit.Assert.assertNotNull(Assert.java:621)
> >
> > at org.junit.Assert.assertNotNull(Assert.java:631)
> >
> > at org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> >
> >
> >
> > Results :
> >
> >
> > Failed tests:
> >
> >   UtilsTest.testUberjarLocator:32 null
> >
> >
> > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> >
> >
> > - Henry
> >
> > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]>
> wrote:
> >> Hi all,
> >>
> >> I tried to build the current master (mvn clean install) and some tests
> in
> >> the flink-yarn-tests module fail:
> >>
> >> Failed tests:
> >>
> >>
> >>
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> >> During the timeout period of 60 seconds the expected string did not
> show up
> >>
> >>   YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> >> There is at least one application on the cluster is not finished
> >>
> >>
>  YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> >> During the timeout period of 60 seconds the expected string did not
> show up
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> >> least one application on the cluster is not finished
> >>
> >>
> >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> >>
> >> Anybody else got this problem?
> >>
> >> Cheers, Fabian
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
Hi,

the tests are passing on travis. Maybe its a issue with your environment.
I'm currently running the tests on my machine as well, just to make sure.
I haven't ran the tests on OS X, maybe that's causing the issues.

Can you send me (privately) the full output of the tests?

Best,
Robert



On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]> wrote:

> Hi Henry,
>
> running "mvn -DskipTests clean install" before "mvn clean install" did not
> fix the build for me.
> The failing tests are also integration tests (*ITCase) which are only
> executed in Maven's verify phase which is not triggered if you run "mvn
> clean test".
> If I run "mvn test" without "mvn install" it fails for me as well with the
> error you posted.
>
> So there seem to be at least two build issues with the current master.
>
> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
>
> > Hmm, I think there could be some weird dependencies to get the Flink
> > YARN uber jar.
> >
> > If you do "mvn clean install -DskipTests" then call "mvn test" all the
> > tests passed.
> >
> > But if you directly call "mvn clean test" then you see the stack I
> > have seen before.
> >
> > - Henry
> >
> >
> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <[hidden email]>
> > wrote:
> > > Did not see that trace but do see this:
> > >
> > > -------------------------------------------------------
> > >
> > >  T E S T S
> > >
> > > -------------------------------------------------------
> > >
> > > Running org.apache.flink.yarn.UtilsTest
> > >
> > > log4j:WARN No such property [append] in
> org.apache.log4j.ConsoleAppender.
> > >
> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.476
> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > >
> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
> > > 0.405 sec  <<< FAILURE!
> > >
> > > java.lang.AssertionError: null
> > >
> > > at org.junit.Assert.fail(Assert.java:86)
> > >
> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > >
> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > >
> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > >
> > > at
> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > >
> > >
> > >
> > > Results :
> > >
> > >
> > > Failed tests:
> > >
> > >   UtilsTest.testUberjarLocator:32 null
> > >
> > >
> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > >
> > >
> > > - Henry
> > >
> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]>
> > wrote:
> > >> Hi all,
> > >>
> > >> I tried to build the current master (mvn clean install) and some tests
> > in
> > >> the flink-yarn-tests module fail:
> > >>
> > >> Failed tests:
> > >>
> > >>
> > >>
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > >> During the timeout period of 60 seconds the expected string did not
> > show up
> > >>
> > >>
>  YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > >> There is at least one application on the cluster is not finished
> > >>
> > >>
> >
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > >> During the timeout period of 60 seconds the expected string did not
> > show up
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is at
> > >> least one application on the cluster is not finished
> > >>
> > >>
> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > >>
> > >> Anybody else got this problem?
> > >>
> > >> Cheers, Fabian
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
Okay, the tests have finished on my local machine, and they passed. So it
looks like an environment specific issue.
Maybe the log helps me already to figure out whats the issue.
We should make sure that our tests are passing on all platforms ;)

On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <[hidden email]>
wrote:

> Hi,
>
> the tests are passing on travis. Maybe its a issue with your environment.
> I'm currently running the tests on my machine as well, just to make sure.
> I haven't ran the tests on OS X, maybe that's causing the issues.
>
> Can you send me (privately) the full output of the tests?
>
> Best,
> Robert
>
>
>
> On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]> wrote:
>
>> Hi Henry,
>>
>> running "mvn -DskipTests clean install" before "mvn clean install" did not
>> fix the build for me.
>> The failing tests are also integration tests (*ITCase) which are only
>> executed in Maven's verify phase which is not triggered if you run "mvn
>> clean test".
>> If I run "mvn test" without "mvn install" it fails for me as well with the
>> error you posted.
>>
>> So there seem to be at least two build issues with the current master.
>>
>> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
>>
>> > Hmm, I think there could be some weird dependencies to get the Flink
>> > YARN uber jar.
>> >
>> > If you do "mvn clean install -DskipTests" then call "mvn test" all the
>> > tests passed.
>> >
>> > But if you directly call "mvn clean test" then you see the stack I
>> > have seen before.
>> >
>> > - Henry
>> >
>> >
>> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <[hidden email]
>> >
>> > wrote:
>> > > Did not see that trace but do see this:
>> > >
>> > > -------------------------------------------------------
>> > >
>> > >  T E S T S
>> > >
>> > > -------------------------------------------------------
>> > >
>> > > Running org.apache.flink.yarn.UtilsTest
>> > >
>> > > log4j:WARN No such property [append] in
>> org.apache.log4j.ConsoleAppender.
>> > >
>> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.476
>> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
>> > >
>> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
>> > > 0.405 sec  <<< FAILURE!
>> > >
>> > > java.lang.AssertionError: null
>> > >
>> > > at org.junit.Assert.fail(Assert.java:86)
>> > >
>> > > at org.junit.Assert.assertTrue(Assert.java:41)
>> > >
>> > > at org.junit.Assert.assertNotNull(Assert.java:621)
>> > >
>> > > at org.junit.Assert.assertNotNull(Assert.java:631)
>> > >
>> > > at
>> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
>> > >
>> > >
>> > >
>> > > Results :
>> > >
>> > >
>> > > Failed tests:
>> > >
>> > >   UtilsTest.testUberjarLocator:32 null
>> > >
>> > >
>> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
>> > >
>> > >
>> > > - Henry
>> > >
>> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]>
>> > wrote:
>> > >> Hi all,
>> > >>
>> > >> I tried to build the current master (mvn clean install) and some
>> tests
>> > in
>> > >> the flink-yarn-tests module fail:
>> > >>
>> > >> Failed tests:
>> > >>
>> > >>
>> > >>
>> >
>> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
>> > >> During the timeout period of 60 seconds the expected string did not
>> > show up
>> > >>
>> > >>
>>  YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
>> > >> There is at least one application on the cluster is not finished
>> > >>
>> > >>
>> >
>> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
>> > >> During the timeout period of 60 seconds the expected string did not
>> > show up
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
>> at
>> > >> least one application on the cluster is not finished
>> > >>
>> > >>
>> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
>> > >>
>> > >> Anybody else got this problem?
>> > >>
>> > >> Cheers, Fabian
>> >
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
Thanks Robert! Sounds indeed like an environment problem.
Will run the tests again and send you the output.

2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:

> Okay, the tests have finished on my local machine, and they passed. So it
> looks like an environment specific issue.
> Maybe the log helps me already to figure out whats the issue.
> We should make sure that our tests are passing on all platforms ;)
>
> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <[hidden email]>
> wrote:
>
> > Hi,
> >
> > the tests are passing on travis. Maybe its a issue with your environment.
> > I'm currently running the tests on my machine as well, just to make sure.
> > I haven't ran the tests on OS X, maybe that's causing the issues.
> >
> > Can you send me (privately) the full output of the tests?
> >
> > Best,
> > Robert
> >
> >
> >
> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]>
> wrote:
> >
> >> Hi Henry,
> >>
> >> running "mvn -DskipTests clean install" before "mvn clean install" did
> not
> >> fix the build for me.
> >> The failing tests are also integration tests (*ITCase) which are only
> >> executed in Maven's verify phase which is not triggered if you run "mvn
> >> clean test".
> >> If I run "mvn test" without "mvn install" it fails for me as well with
> the
> >> error you posted.
> >>
> >> So there seem to be at least two build issues with the current master.
> >>
> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
> >>
> >> > Hmm, I think there could be some weird dependencies to get the Flink
> >> > YARN uber jar.
> >> >
> >> > If you do "mvn clean install -DskipTests" then call "mvn test" all the
> >> > tests passed.
> >> >
> >> > But if you directly call "mvn clean test" then you see the stack I
> >> > have seen before.
> >> >
> >> > - Henry
> >> >
> >> >
> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> [hidden email]
> >> >
> >> > wrote:
> >> > > Did not see that trace but do see this:
> >> > >
> >> > > -------------------------------------------------------
> >> > >
> >> > >  T E S T S
> >> > >
> >> > > -------------------------------------------------------
> >> > >
> >> > > Running org.apache.flink.yarn.UtilsTest
> >> > >
> >> > > log4j:WARN No such property [append] in
> >> org.apache.log4j.ConsoleAppender.
> >> > >
> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 0.476
> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> >> > >
> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
> >> > > 0.405 sec  <<< FAILURE!
> >> > >
> >> > > java.lang.AssertionError: null
> >> > >
> >> > > at org.junit.Assert.fail(Assert.java:86)
> >> > >
> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> >> > >
> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> >> > >
> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> >> > >
> >> > > at
> >> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> >> > >
> >> > >
> >> > >
> >> > > Results :
> >> > >
> >> > >
> >> > > Failed tests:
> >> > >
> >> > >   UtilsTest.testUberjarLocator:32 null
> >> > >
> >> > >
> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> >> > >
> >> > >
> >> > > - Henry
> >> > >
> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]>
> >> > wrote:
> >> > >> Hi all,
> >> > >>
> >> > >> I tried to build the current master (mvn clean install) and some
> >> tests
> >> > in
> >> > >> the flink-yarn-tests module fail:
> >> > >>
> >> > >> Failed tests:
> >> > >>
> >> > >>
> >> > >>
> >> >
> >>
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> >> > >> During the timeout period of 60 seconds the expected string did not
> >> > show up
> >> > >>
> >> > >>
> >>  YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> >> > >> There is at least one application on the cluster is not finished
> >> > >>
> >> > >>
> >> >
> >>
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> >> > >> During the timeout period of 60 seconds the expected string did not
> >> > show up
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There is
> >> at
> >> > >> least one application on the cluster is not finished
> >> > >>
> >> > >>
> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> >> > >>
> >> > >> Anybody else got this problem?
> >> > >>
> >> > >> Cheers, Fabian
> >> >
> >>
> >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
I just tried to build ("mvn clean install") on a fresh Ubuntu VM. Fails
with the same exception as natively on MacOS.
Something strange is going on...

2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:

> Thanks Robert! Sounds indeed like an environment problem.
> Will run the tests again and send you the output.
>
> 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
>
>> Okay, the tests have finished on my local machine, and they passed. So it
>> looks like an environment specific issue.
>> Maybe the log helps me already to figure out whats the issue.
>> We should make sure that our tests are passing on all platforms ;)
>>
>> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <[hidden email]>
>> wrote:
>>
>> > Hi,
>> >
>> > the tests are passing on travis. Maybe its a issue with your
>> environment.
>> > I'm currently running the tests on my machine as well, just to make
>> sure.
>> > I haven't ran the tests on OS X, maybe that's causing the issues.
>> >
>> > Can you send me (privately) the full output of the tests?
>> >
>> > Best,
>> > Robert
>> >
>> >
>> >
>> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]>
>> wrote:
>> >
>> >> Hi Henry,
>> >>
>> >> running "mvn -DskipTests clean install" before "mvn clean install" did
>> not
>> >> fix the build for me.
>> >> The failing tests are also integration tests (*ITCase) which are only
>> >> executed in Maven's verify phase which is not triggered if you run "mvn
>> >> clean test".
>> >> If I run "mvn test" without "mvn install" it fails for me as well with
>> the
>> >> error you posted.
>> >>
>> >> So there seem to be at least two build issues with the current master.
>> >>
>> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
>> >>
>> >> > Hmm, I think there could be some weird dependencies to get the Flink
>> >> > YARN uber jar.
>> >> >
>> >> > If you do "mvn clean install -DskipTests" then call "mvn test" all
>> the
>> >> > tests passed.
>> >> >
>> >> > But if you directly call "mvn clean test" then you see the stack I
>> >> > have seen before.
>> >> >
>> >> > - Henry
>> >> >
>> >> >
>> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
>> [hidden email]
>> >> >
>> >> > wrote:
>> >> > > Did not see that trace but do see this:
>> >> > >
>> >> > > -------------------------------------------------------
>> >> > >
>> >> > >  T E S T S
>> >> > >
>> >> > > -------------------------------------------------------
>> >> > >
>> >> > > Running org.apache.flink.yarn.UtilsTest
>> >> > >
>> >> > > log4j:WARN No such property [append] in
>> >> org.apache.log4j.ConsoleAppender.
>> >> > >
>> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
>> 0.476
>> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
>> >> > >
>> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time elapsed:
>> >> > > 0.405 sec  <<< FAILURE!
>> >> > >
>> >> > > java.lang.AssertionError: null
>> >> > >
>> >> > > at org.junit.Assert.fail(Assert.java:86)
>> >> > >
>> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
>> >> > >
>> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
>> >> > >
>> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
>> >> > >
>> >> > > at
>> >> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
>> >> > >
>> >> > >
>> >> > >
>> >> > > Results :
>> >> > >
>> >> > >
>> >> > > Failed tests:
>> >> > >
>> >> > >   UtilsTest.testUberjarLocator:32 null
>> >> > >
>> >> > >
>> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
>> >> > >
>> >> > >
>> >> > > - Henry
>> >> > >
>> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <[hidden email]>
>> >> > wrote:
>> >> > >> Hi all,
>> >> > >>
>> >> > >> I tried to build the current master (mvn clean install) and some
>> >> tests
>> >> > in
>> >> > >> the flink-yarn-tests module fail:
>> >> > >>
>> >> > >> Failed tests:
>> >> > >>
>> >> > >>
>> >> > >>
>> >> >
>> >>
>> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
>> >> > >> During the timeout period of 60 seconds the expected string did
>> not
>> >> > show up
>> >> > >>
>> >> > >>
>> >>  YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
>> >> > >> There is at least one application on the cluster is not finished
>> >> > >>
>> >> > >>
>> >> >
>> >>
>> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
>> >> > >> During the timeout period of 60 seconds the expected string did
>> not
>> >> > show up
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
>> is
>> >> at
>> >> > >> least one application on the cluster is not finished
>> >> > >>
>> >> > >>
>> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
>> >> > >>
>> >> > >> Anybody else got this problem?
>> >> > >>
>> >> > >> Cheers, Fabian
>> >> >
>> >>
>> >
>> >
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Stephan Ewen
Is this reproducible on a machine when you delete the .m2/repository
directory (local maven cache) ?

(I currently cannot try that because I am behind a rather low-bandwith
connection and would take very long to re-download all dependency artifacts)

On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]> wrote:

> I just tried to build ("mvn clean install") on a fresh Ubuntu VM. Fails
> with the same exception as natively on MacOS.
> Something strange is going on...
>
> 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
>
> > Thanks Robert! Sounds indeed like an environment problem.
> > Will run the tests again and send you the output.
> >
> > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
> >
> >> Okay, the tests have finished on my local machine, and they passed. So
> it
> >> looks like an environment specific issue.
> >> Maybe the log helps me already to figure out whats the issue.
> >> We should make sure that our tests are passing on all platforms ;)
> >>
> >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <[hidden email]>
> >> wrote:
> >>
> >> > Hi,
> >> >
> >> > the tests are passing on travis. Maybe its a issue with your
> >> environment.
> >> > I'm currently running the tests on my machine as well, just to make
> >> sure.
> >> > I haven't ran the tests on OS X, maybe that's causing the issues.
> >> >
> >> > Can you send me (privately) the full output of the tests?
> >> >
> >> > Best,
> >> > Robert
> >> >
> >> >
> >> >
> >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]>
> >> wrote:
> >> >
> >> >> Hi Henry,
> >> >>
> >> >> running "mvn -DskipTests clean install" before "mvn clean install"
> did
> >> not
> >> >> fix the build for me.
> >> >> The failing tests are also integration tests (*ITCase) which are only
> >> >> executed in Maven's verify phase which is not triggered if you run
> "mvn
> >> >> clean test".
> >> >> If I run "mvn test" without "mvn install" it fails for me as well
> with
> >> the
> >> >> error you posted.
> >> >>
> >> >> So there seem to be at least two build issues with the current
> master.
> >> >>
> >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
> >> >>
> >> >> > Hmm, I think there could be some weird dependencies to get the
> Flink
> >> >> > YARN uber jar.
> >> >> >
> >> >> > If you do "mvn clean install -DskipTests" then call "mvn test" all
> >> the
> >> >> > tests passed.
> >> >> >
> >> >> > But if you directly call "mvn clean test" then you see the stack I
> >> >> > have seen before.
> >> >> >
> >> >> > - Henry
> >> >> >
> >> >> >
> >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> >> [hidden email]
> >> >> >
> >> >> > wrote:
> >> >> > > Did not see that trace but do see this:
> >> >> > >
> >> >> > > -------------------------------------------------------
> >> >> > >
> >> >> > >  T E S T S
> >> >> > >
> >> >> > > -------------------------------------------------------
> >> >> > >
> >> >> > > Running org.apache.flink.yarn.UtilsTest
> >> >> > >
> >> >> > > log4j:WARN No such property [append] in
> >> >> org.apache.log4j.ConsoleAppender.
> >> >> > >
> >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> >> 0.476
> >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> >> >> > >
> >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time
> elapsed:
> >> >> > > 0.405 sec  <<< FAILURE!
> >> >> > >
> >> >> > > java.lang.AssertionError: null
> >> >> > >
> >> >> > > at org.junit.Assert.fail(Assert.java:86)
> >> >> > >
> >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> >> >> > >
> >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> >> >> > >
> >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> >> >> > >
> >> >> > > at
> >> >> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> >> >> > >
> >> >> > >
> >> >> > >
> >> >> > > Results :
> >> >> > >
> >> >> > >
> >> >> > > Failed tests:
> >> >> > >
> >> >> > >   UtilsTest.testUberjarLocator:32 null
> >> >> > >
> >> >> > >
> >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> >> >> > >
> >> >> > >
> >> >> > > - Henry
> >> >> > >
> >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> [hidden email]>
> >> >> > wrote:
> >> >> > >> Hi all,
> >> >> > >>
> >> >> > >> I tried to build the current master (mvn clean install) and some
> >> >> tests
> >> >> > in
> >> >> > >> the flink-yarn-tests module fail:
> >> >> > >>
> >> >> > >> Failed tests:
> >> >> > >>
> >> >> > >>
> >> >> > >>
> >> >> >
> >> >>
> >>
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> >> >> > >> During the timeout period of 60 seconds the expected string did
> >> not
> >> >> > show up
> >> >> > >>
> >> >> > >>
> >> >>
> YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> >> >> > >> There is at least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>
> >> >> >
> >> >>
> >>
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> >> >> > >> During the timeout period of 60 seconds the expected string did
> >> not
> >> >> > show up
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146 There
> >> is
> >> >> at
> >> >> > >> least one application on the cluster is not finished
> >> >> > >>
> >> >> > >>
> >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> >> >> > >>
> >> >> > >> Anybody else got this problem?
> >> >> > >>
> >> >> > >> Cheers, Fabian
> >> >> >
> >> >>
> >> >
> >> >
> >>
> >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
The build fails also after the .m2 repository was deleted.

Does anybody else have this problem?

2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:

> Is this reproducible on a machine when you delete the .m2/repository
> directory (local maven cache) ?
>
> (I currently cannot try that because I am behind a rather low-bandwith
> connection and would take very long to re-download all dependency
> artifacts)
>
> On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]> wrote:
>
> > I just tried to build ("mvn clean install") on a fresh Ubuntu VM. Fails
> > with the same exception as natively on MacOS.
> > Something strange is going on...
> >
> > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> >
> > > Thanks Robert! Sounds indeed like an environment problem.
> > > Will run the tests again and send you the output.
> > >
> > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
> > >
> > >> Okay, the tests have finished on my local machine, and they passed. So
> > it
> > >> looks like an environment specific issue.
> > >> Maybe the log helps me already to figure out whats the issue.
> > >> We should make sure that our tests are passing on all platforms ;)
> > >>
> > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <[hidden email]
> >
> > >> wrote:
> > >>
> > >> > Hi,
> > >> >
> > >> > the tests are passing on travis. Maybe its a issue with your
> > >> environment.
> > >> > I'm currently running the tests on my machine as well, just to make
> > >> sure.
> > >> > I haven't ran the tests on OS X, maybe that's causing the issues.
> > >> >
> > >> > Can you send me (privately) the full output of the tests?
> > >> >
> > >> > Best,
> > >> > Robert
> > >> >
> > >> >
> > >> >
> > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <[hidden email]>
> > >> wrote:
> > >> >
> > >> >> Hi Henry,
> > >> >>
> > >> >> running "mvn -DskipTests clean install" before "mvn clean install"
> > did
> > >> not
> > >> >> fix the build for me.
> > >> >> The failing tests are also integration tests (*ITCase) which are
> only
> > >> >> executed in Maven's verify phase which is not triggered if you run
> > "mvn
> > >> >> clean test".
> > >> >> If I run "mvn test" without "mvn install" it fails for me as well
> > with
> > >> the
> > >> >> error you posted.
> > >> >>
> > >> >> So there seem to be at least two build issues with the current
> > master.
> > >> >>
> > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]>:
> > >> >>
> > >> >> > Hmm, I think there could be some weird dependencies to get the
> > Flink
> > >> >> > YARN uber jar.
> > >> >> >
> > >> >> > If you do "mvn clean install -DskipTests" then call "mvn test"
> all
> > >> the
> > >> >> > tests passed.
> > >> >> >
> > >> >> > But if you directly call "mvn clean test" then you see the stack
> I
> > >> >> > have seen before.
> > >> >> >
> > >> >> > - Henry
> > >> >> >
> > >> >> >
> > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > >> [hidden email]
> > >> >> >
> > >> >> > wrote:
> > >> >> > > Did not see that trace but do see this:
> > >> >> > >
> > >> >> > > -------------------------------------------------------
> > >> >> > >
> > >> >> > >  T E S T S
> > >> >> > >
> > >> >> > > -------------------------------------------------------
> > >> >> > >
> > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > >> >> > >
> > >> >> > > log4j:WARN No such property [append] in
> > >> >> org.apache.log4j.ConsoleAppender.
> > >> >> > >
> > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> > >> 0.476
> > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > >> >> > >
> > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time
> > elapsed:
> > >> >> > > 0.405 sec  <<< FAILURE!
> > >> >> > >
> > >> >> > > java.lang.AssertionError: null
> > >> >> > >
> > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > >> >> > >
> > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > >> >> > >
> > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > >> >> > >
> > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > >> >> > >
> > >> >> > > at
> > >> >>
> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > >> >> > >
> > >> >> > >
> > >> >> > >
> > >> >> > > Results :
> > >> >> > >
> > >> >> > >
> > >> >> > > Failed tests:
> > >> >> > >
> > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > >> >> > >
> > >> >> > >
> > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > >> >> > >
> > >> >> > >
> > >> >> > > - Henry
> > >> >> > >
> > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > [hidden email]>
> > >> >> > wrote:
> > >> >> > >> Hi all,
> > >> >> > >>
> > >> >> > >> I tried to build the current master (mvn clean install) and
> some
> > >> >> tests
> > >> >> > in
> > >> >> > >> the flink-yarn-tests module fail:
> > >> >> > >>
> > >> >> > >> Failed tests:
> > >> >> > >>
> > >> >> > >>
> > >> >> > >>
> > >> >> >
> > >> >>
> > >>
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > >> >> > >> During the timeout period of 60 seconds the expected string
> did
> > >> not
> > >> >> > show up
> > >> >> > >>
> > >> >> > >>
> > >> >>
> > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > >> >> > >> There is at least one application on the cluster is not
> finished
> > >> >> > >>
> > >> >> > >>
> > >> >> >
> > >> >>
> > >>
> > YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > >> >> > >> During the timeout period of 60 seconds the expected string
> did
> > >> not
> > >> >> > show up
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> There
> > >> is
> > >> >> at
> > >> >> > >> least one application on the cluster is not finished
> > >> >> > >>
> > >> >> > >>
> > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > >> >> > >>
> > >> >> > >> Anybody else got this problem?
> > >> >> > >>
> > >> >> > >> Cheers, Fabian
> > >> >> >
> > >> >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Vasiliki Kalavri
Hi,

"mvn clean verify" fails for me on Ubuntu with deleted .m2 repository.
I'm getting the following:

Results :

Failed tests:
  YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249 null

YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
null

Tests run: 2, Failures: 2, Errors: 0, Skipped: 0

-V.

On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]> wrote:

> The build fails also after the .m2 repository was deleted.
>
> Does anybody else have this problem?
>
> 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
>
> > Is this reproducible on a machine when you delete the .m2/repository
> > directory (local maven cache) ?
> >
> > (I currently cannot try that because I am behind a rather low-bandwith
> > connection and would take very long to re-download all dependency
> > artifacts)
> >
> > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]>
> wrote:
> >
> > > I just tried to build ("mvn clean install") on a fresh Ubuntu VM. Fails
> > > with the same exception as natively on MacOS.
> > > Something strange is going on...
> > >
> > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> > >
> > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > Will run the tests again and send you the output.
> > > >
> > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
> > > >
> > > >> Okay, the tests have finished on my local machine, and they passed.
> So
> > > it
> > > >> looks like an environment specific issue.
> > > >> Maybe the log helps me already to figure out whats the issue.
> > > >> We should make sure that our tests are passing on all platforms ;)
> > > >>
> > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> [hidden email]
> > >
> > > >> wrote:
> > > >>
> > > >> > Hi,
> > > >> >
> > > >> > the tests are passing on travis. Maybe its a issue with your
> > > >> environment.
> > > >> > I'm currently running the tests on my machine as well, just to
> make
> > > >> sure.
> > > >> > I haven't ran the tests on OS X, maybe that's causing the issues.
> > > >> >
> > > >> > Can you send me (privately) the full output of the tests?
> > > >> >
> > > >> > Best,
> > > >> > Robert
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> [hidden email]>
> > > >> wrote:
> > > >> >
> > > >> >> Hi Henry,
> > > >> >>
> > > >> >> running "mvn -DskipTests clean install" before "mvn clean
> install"
> > > did
> > > >> not
> > > >> >> fix the build for me.
> > > >> >> The failing tests are also integration tests (*ITCase) which are
> > only
> > > >> >> executed in Maven's verify phase which is not triggered if you
> run
> > > "mvn
> > > >> >> clean test".
> > > >> >> If I run "mvn test" without "mvn install" it fails for me as well
> > > with
> > > >> the
> > > >> >> error you posted.
> > > >> >>
> > > >> >> So there seem to be at least two build issues with the current
> > > master.
> > > >> >>
> > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <[hidden email]
> >:
> > > >> >>
> > > >> >> > Hmm, I think there could be some weird dependencies to get the
> > > Flink
> > > >> >> > YARN uber jar.
> > > >> >> >
> > > >> >> > If you do "mvn clean install -DskipTests" then call "mvn test"
> > all
> > > >> the
> > > >> >> > tests passed.
> > > >> >> >
> > > >> >> > But if you directly call "mvn clean test" then you see the
> stack
> > I
> > > >> >> > have seen before.
> > > >> >> >
> > > >> >> > - Henry
> > > >> >> >
> > > >> >> >
> > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > >> [hidden email]
> > > >> >> >
> > > >> >> > wrote:
> > > >> >> > > Did not see that trace but do see this:
> > > >> >> > >
> > > >> >> > > -------------------------------------------------------
> > > >> >> > >
> > > >> >> > >  T E S T S
> > > >> >> > >
> > > >> >> > > -------------------------------------------------------
> > > >> >> > >
> > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > >> >> > >
> > > >> >> > > log4j:WARN No such property [append] in
> > > >> >> org.apache.log4j.ConsoleAppender.
> > > >> >> > >
> > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time
> elapsed:
> > > >> 0.476
> > > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > > >> >> > >
> > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time
> > > elapsed:
> > > >> >> > > 0.405 sec  <<< FAILURE!
> > > >> >> > >
> > > >> >> > > java.lang.AssertionError: null
> > > >> >> > >
> > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > >> >> > >
> > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > >> >> > >
> > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > >> >> > >
> > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > >> >> > >
> > > >> >> > > at
> > > >> >>
> > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > >> >> > >
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > Results :
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > Failed tests:
> > > >> >> > >
> > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > - Henry
> > > >> >> > >
> > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > [hidden email]>
> > > >> >> > wrote:
> > > >> >> > >> Hi all,
> > > >> >> > >>
> > > >> >> > >> I tried to build the current master (mvn clean install) and
> > some
> > > >> >> tests
> > > >> >> > in
> > > >> >> > >> the flink-yarn-tests module fail:
> > > >> >> > >>
> > > >> >> > >> Failed tests:
> > > >> >> > >>
> > > >> >> > >>
> > > >> >> > >>
> > > >> >> >
> > > >> >>
> > > >>
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > >> >> > >> During the timeout period of 60 seconds the expected string
> > did
> > > >> not
> > > >> >> > show up
> > > >> >> > >>
> > > >> >> > >>
> > > >> >>
> > > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > >> >> > >> There is at least one application on the cluster is not
> > finished
> > > >> >> > >>
> > > >> >> > >>
> > > >> >> >
> > > >> >>
> > > >>
> > >
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > >> >> > >> During the timeout period of 60 seconds the expected string
> > did
> > > >> not
> > > >> >> > show up
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > There
> > > >> is
> > > >> >> at
> > > >> >> > >> least one application on the cluster is not finished
> > > >> >> > >>
> > > >> >> > >>
> > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > >> >> > >>
> > > >> >> > >> Anybody else got this problem?
> > > >> >> > >>
> > > >> >> > >> Cheers, Fabian
> > > >> >> >
> > > >> >>
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
I also had errors when running the tests in an Ubuntu virtual machine,
caused by limited memory resources.

Do you think its okay to assume that we have at least 3 GB of main memory
available for running the tests? Thats what we have with Travis. The YARN
tests are very memory intensive, because YARN itself has a bunch of
services (resource manager, 2 node managers) and we allocate some
containers there, which all need memory.

The main problem is that the amount of memory per node manager is
hard-coded to 4GB. I've already opened an issue in the Hadoop project and
will fix the issue there...

But I think I have some ideas how to work around the memory limitations for
now.



On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
[hidden email]> wrote:

> Hi,
>
> "mvn clean verify" fails for me on Ubuntu with deleted .m2 repository.
> I'm getting the following:
>
> Results :
>
> Failed tests:
>   YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249 null
>
>
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> null
>
> Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
>
> -V.
>
> On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]> wrote:
>
> > The build fails also after the .m2 repository was deleted.
> >
> > Does anybody else have this problem?
> >
> > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> >
> > > Is this reproducible on a machine when you delete the .m2/repository
> > > directory (local maven cache) ?
> > >
> > > (I currently cannot try that because I am behind a rather low-bandwith
> > > connection and would take very long to re-download all dependency
> > > artifacts)
> > >
> > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]>
> > wrote:
> > >
> > > > I just tried to build ("mvn clean install") on a fresh Ubuntu VM.
> Fails
> > > > with the same exception as natively on MacOS.
> > > > Something strange is going on...
> > > >
> > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> > > >
> > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > Will run the tests again and send you the output.
> > > > >
> > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
> > > > >
> > > > >> Okay, the tests have finished on my local machine, and they
> passed.
> > So
> > > > it
> > > > >> looks like an environment specific issue.
> > > > >> Maybe the log helps me already to figure out whats the issue.
> > > > >> We should make sure that our tests are passing on all platforms ;)
> > > > >>
> > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > [hidden email]
> > > >
> > > > >> wrote:
> > > > >>
> > > > >> > Hi,
> > > > >> >
> > > > >> > the tests are passing on travis. Maybe its a issue with your
> > > > >> environment.
> > > > >> > I'm currently running the tests on my machine as well, just to
> > make
> > > > >> sure.
> > > > >> > I haven't ran the tests on OS X, maybe that's causing the
> issues.
> > > > >> >
> > > > >> > Can you send me (privately) the full output of the tests?
> > > > >> >
> > > > >> > Best,
> > > > >> > Robert
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > [hidden email]>
> > > > >> wrote:
> > > > >> >
> > > > >> >> Hi Henry,
> > > > >> >>
> > > > >> >> running "mvn -DskipTests clean install" before "mvn clean
> > install"
> > > > did
> > > > >> not
> > > > >> >> fix the build for me.
> > > > >> >> The failing tests are also integration tests (*ITCase) which
> are
> > > only
> > > > >> >> executed in Maven's verify phase which is not triggered if you
> > run
> > > > "mvn
> > > > >> >> clean test".
> > > > >> >> If I run "mvn test" without "mvn install" it fails for me as
> well
> > > > with
> > > > >> the
> > > > >> >> error you posted.
> > > > >> >>
> > > > >> >> So there seem to be at least two build issues with the current
> > > > master.
> > > > >> >>
> > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> [hidden email]
> > >:
> > > > >> >>
> > > > >> >> > Hmm, I think there could be some weird dependencies to get
> the
> > > > Flink
> > > > >> >> > YARN uber jar.
> > > > >> >> >
> > > > >> >> > If you do "mvn clean install -DskipTests" then call "mvn
> test"
> > > all
> > > > >> the
> > > > >> >> > tests passed.
> > > > >> >> >
> > > > >> >> > But if you directly call "mvn clean test" then you see the
> > stack
> > > I
> > > > >> >> > have seen before.
> > > > >> >> >
> > > > >> >> > - Henry
> > > > >> >> >
> > > > >> >> >
> > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > >> [hidden email]
> > > > >> >> >
> > > > >> >> > wrote:
> > > > >> >> > > Did not see that trace but do see this:
> > > > >> >> > >
> > > > >> >> > > -------------------------------------------------------
> > > > >> >> > >
> > > > >> >> > >  T E S T S
> > > > >> >> > >
> > > > >> >> > > -------------------------------------------------------
> > > > >> >> > >
> > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > >> >> > >
> > > > >> >> > > log4j:WARN No such property [append] in
> > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > >> >> > >
> > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time
> > elapsed:
> > > > >> 0.476
> > > > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > > > >> >> > >
> > > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time
> > > > elapsed:
> > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > >> >> > >
> > > > >> >> > > java.lang.AssertionError: null
> > > > >> >> > >
> > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > >> >> > >
> > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > >> >> > >
> > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > > >> >> > >
> > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > > >> >> > >
> > > > >> >> > > at
> > > > >> >>
> > > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > Results :
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > Failed tests:
> > > > >> >> > >
> > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > - Henry
> > > > >> >> > >
> > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > [hidden email]>
> > > > >> >> > wrote:
> > > > >> >> > >> Hi all,
> > > > >> >> > >>
> > > > >> >> > >> I tried to build the current master (mvn clean install)
> and
> > > some
> > > > >> >> tests
> > > > >> >> > in
> > > > >> >> > >> the flink-yarn-tests module fail:
> > > > >> >> > >>
> > > > >> >> > >> Failed tests:
> > > > >> >> > >>
> > > > >> >> > >>
> > > > >> >> > >>
> > > > >> >> >
> > > > >> >>
> > > > >>
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > >> >> > >> During the timeout period of 60 seconds the expected
> string
> > > did
> > > > >> not
> > > > >> >> > show up
> > > > >> >> > >>
> > > > >> >> > >>
> > > > >> >>
> > > > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > >> >> > >> There is at least one application on the cluster is not
> > > finished
> > > > >> >> > >>
> > > > >> >> > >>
> > > > >> >> >
> > > > >> >>
> > > > >>
> > > >
> > YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > >> >> > >> During the timeout period of 60 seconds the expected
> string
> > > did
> > > > >> not
> > > > >> >> > show up
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>   YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > There
> > > > >> is
> > > > >> >> at
> > > > >> >> > >> least one application on the cluster is not finished
> > > > >> >> > >>
> > > > >> >> > >>
> > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > > >> >> > >>
> > > > >> >> > >> Anybody else got this problem?
> > > > >> >> > >>
> > > > >> >> > >> Cheers, Fabian
> > > > >> >> >
> > > > >> >>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
My VM is configured with 6GB and the OS X host has 16GB. In both setups the
error was identical (with and without cleared .m2).
If the tests pass on a 3GB Travis host, I doubt that my errors are caused
by lack of memory.

2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:

> I also had errors when running the tests in an Ubuntu virtual machine,
> caused by limited memory resources.
>
> Do you think its okay to assume that we have at least 3 GB of main memory
> available for running the tests? Thats what we have with Travis. The YARN
> tests are very memory intensive, because YARN itself has a bunch of
> services (resource manager, 2 node managers) and we allocate some
> containers there, which all need memory.
>
> The main problem is that the amount of memory per node manager is
> hard-coded to 4GB. I've already opened an issue in the Hadoop project and
> will fix the issue there...
>
> But I think I have some ideas how to work around the memory limitations for
> now.
>
>
>
> On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> [hidden email]> wrote:
>
> > Hi,
> >
> > "mvn clean verify" fails for me on Ubuntu with deleted .m2 repository.
> > I'm getting the following:
> >
> > Results :
> >
> > Failed tests:
> >   YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> null
> >
> >
> >
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> > null
> >
> > Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> >
> > -V.
> >
> > On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]> wrote:
> >
> > > The build fails also after the .m2 repository was deleted.
> > >
> > > Does anybody else have this problem?
> > >
> > > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> > >
> > > > Is this reproducible on a machine when you delete the .m2/repository
> > > > directory (local maven cache) ?
> > > >
> > > > (I currently cannot try that because I am behind a rather
> low-bandwith
> > > > connection and would take very long to re-download all dependency
> > > > artifacts)
> > > >
> > > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]>
> > > wrote:
> > > >
> > > > > I just tried to build ("mvn clean install") on a fresh Ubuntu VM.
> > Fails
> > > > > with the same exception as natively on MacOS.
> > > > > Something strange is going on...
> > > > >
> > > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> > > > >
> > > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > > Will run the tests again and send you the output.
> > > > > >
> > > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]>:
> > > > > >
> > > > > >> Okay, the tests have finished on my local machine, and they
> > passed.
> > > So
> > > > > it
> > > > > >> looks like an environment specific issue.
> > > > > >> Maybe the log helps me already to figure out whats the issue.
> > > > > >> We should make sure that our tests are passing on all platforms
> ;)
> > > > > >>
> > > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > > [hidden email]
> > > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi,
> > > > > >> >
> > > > > >> > the tests are passing on travis. Maybe its a issue with your
> > > > > >> environment.
> > > > > >> > I'm currently running the tests on my machine as well, just to
> > > make
> > > > > >> sure.
> > > > > >> > I haven't ran the tests on OS X, maybe that's causing the
> > issues.
> > > > > >> >
> > > > > >> > Can you send me (privately) the full output of the tests?
> > > > > >> >
> > > > > >> > Best,
> > > > > >> > Robert
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > > [hidden email]>
> > > > > >> wrote:
> > > > > >> >
> > > > > >> >> Hi Henry,
> > > > > >> >>
> > > > > >> >> running "mvn -DskipTests clean install" before "mvn clean
> > > install"
> > > > > did
> > > > > >> not
> > > > > >> >> fix the build for me.
> > > > > >> >> The failing tests are also integration tests (*ITCase) which
> > are
> > > > only
> > > > > >> >> executed in Maven's verify phase which is not triggered if
> you
> > > run
> > > > > "mvn
> > > > > >> >> clean test".
> > > > > >> >> If I run "mvn test" without "mvn install" it fails for me as
> > well
> > > > > with
> > > > > >> the
> > > > > >> >> error you posted.
> > > > > >> >>
> > > > > >> >> So there seem to be at least two build issues with the
> current
> > > > > master.
> > > > > >> >>
> > > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> > [hidden email]
> > > >:
> > > > > >> >>
> > > > > >> >> > Hmm, I think there could be some weird dependencies to get
> > the
> > > > > Flink
> > > > > >> >> > YARN uber jar.
> > > > > >> >> >
> > > > > >> >> > If you do "mvn clean install -DskipTests" then call "mvn
> > test"
> > > > all
> > > > > >> the
> > > > > >> >> > tests passed.
> > > > > >> >> >
> > > > > >> >> > But if you directly call "mvn clean test" then you see the
> > > stack
> > > > I
> > > > > >> >> > have seen before.
> > > > > >> >> >
> > > > > >> >> > - Henry
> > > > > >> >> >
> > > > > >> >> >
> > > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > > >> [hidden email]
> > > > > >> >> >
> > > > > >> >> > wrote:
> > > > > >> >> > > Did not see that trace but do see this:
> > > > > >> >> > >
> > > > > >> >> > > -------------------------------------------------------
> > > > > >> >> > >
> > > > > >> >> > >  T E S T S
> > > > > >> >> > >
> > > > > >> >> > > -------------------------------------------------------
> > > > > >> >> > >
> > > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > > >> >> > >
> > > > > >> >> > > log4j:WARN No such property [append] in
> > > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > > >> >> > >
> > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time
> > > elapsed:
> > > > > >> 0.476
> > > > > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > > > > >> >> > >
> > > > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)  Time
> > > > > elapsed:
> > > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > > >> >> > >
> > > > > >> >> > > java.lang.AssertionError: null
> > > > > >> >> > >
> > > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > > >> >> > >
> > > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > > >> >> > >
> > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > > > >> >> > >
> > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > > > >> >> > >
> > > > > >> >> > > at
> > > > > >> >>
> > > > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > > Results :
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > > Failed tests:
> > > > > >> >> > >
> > > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > > - Henry
> > > > > >> >> > >
> > > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > > [hidden email]>
> > > > > >> >> > wrote:
> > > > > >> >> > >> Hi all,
> > > > > >> >> > >>
> > > > > >> >> > >> I tried to build the current master (mvn clean install)
> > and
> > > > some
> > > > > >> >> tests
> > > > > >> >> > in
> > > > > >> >> > >> the flink-yarn-tests module fail:
> > > > > >> >> > >>
> > > > > >> >> > >> Failed tests:
> > > > > >> >> > >>
> > > > > >> >> > >>
> > > > > >> >> > >>
> > > > > >> >> >
> > > > > >> >>
> > > > > >>
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > string
> > > > did
> > > > > >> not
> > > > > >> >> > show up
> > > > > >> >> > >>
> > > > > >> >> > >>
> > > > > >> >>
> > > > >
> YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > > >> >> > >> There is at least one application on the cluster is not
> > > > finished
> > > > > >> >> > >>
> > > > > >> >> > >>
> > > > > >> >> >
> > > > > >> >>
> > > > > >>
> > > > >
> > >
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > string
> > > > did
> > > > > >> not
> > > > > >> >> > show up
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
>  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > There
> > > > > >> is
> > > > > >> >> at
> > > > > >> >> > >> least one application on the cluster is not finished
> > > > > >> >> > >>
> > > > > >> >> > >>
> > > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > > > >> >> > >>
> > > > > >> >> > >> Anybody else got this problem?
> > > > > >> >> > >>
> > > > > >> >> > >> Cheers, Fabian
> > > > > >> >> >
> > > > > >> >>
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
Can you give me the exact version of the Ubuntu VM?
Do you have a swapfile on the Ubuntu VM? The tests might currently allocate
up to 8 GB of memory, so maybe your VM is starting to swap and thats why
the test runs out of the timeout. (That would not explain the failure on
OSX)

I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one test
failed.

On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]> wrote:

> My VM is configured with 6GB and the OS X host has 16GB. In both setups the
> error was identical (with and without cleared .m2).
> If the tests pass on a 3GB Travis host, I doubt that my errors are caused
> by lack of memory.
>
> 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
>
> > I also had errors when running the tests in an Ubuntu virtual machine,
> > caused by limited memory resources.
> >
> > Do you think its okay to assume that we have at least 3 GB of main memory
> > available for running the tests? Thats what we have with Travis. The YARN
> > tests are very memory intensive, because YARN itself has a bunch of
> > services (resource manager, 2 node managers) and we allocate some
> > containers there, which all need memory.
> >
> > The main problem is that the amount of memory per node manager is
> > hard-coded to 4GB. I've already opened an issue in the Hadoop project and
> > will fix the issue there...
> >
> > But I think I have some ideas how to work around the memory limitations
> for
> > now.
> >
> >
> >
> > On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> > [hidden email]> wrote:
> >
> > > Hi,
> > >
> > > "mvn clean verify" fails for me on Ubuntu with deleted .m2 repository.
> > > I'm getting the following:
> > >
> > > Results :
> > >
> > > Failed tests:
> > >   YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> > null
> > >
> > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> > > null
> > >
> > > Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> > >
> > > -V.
> > >
> > > On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]> wrote:
> > >
> > > > The build fails also after the .m2 repository was deleted.
> > > >
> > > > Does anybody else have this problem?
> > > >
> > > > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> > > >
> > > > > Is this reproducible on a machine when you delete the
> .m2/repository
> > > > > directory (local maven cache) ?
> > > > >
> > > > > (I currently cannot try that because I am behind a rather
> > low-bandwith
> > > > > connection and would take very long to re-download all dependency
> > > > > artifacts)
> > > > >
> > > > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <[hidden email]>
> > > > wrote:
> > > > >
> > > > > > I just tried to build ("mvn clean install") on a fresh Ubuntu VM.
> > > Fails
> > > > > > with the same exception as natively on MacOS.
> > > > > > Something strange is going on...
> > > > > >
> > > > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> > > > > >
> > > > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > > > Will run the tests again and send you the output.
> > > > > > >
> > > > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <[hidden email]
> >:
> > > > > > >
> > > > > > >> Okay, the tests have finished on my local machine, and they
> > > passed.
> > > > So
> > > > > > it
> > > > > > >> looks like an environment specific issue.
> > > > > > >> Maybe the log helps me already to figure out whats the issue.
> > > > > > >> We should make sure that our tests are passing on all
> platforms
> > ;)
> > > > > > >>
> > > > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > > > [hidden email]
> > > > > >
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > Hi,
> > > > > > >> >
> > > > > > >> > the tests are passing on travis. Maybe its a issue with your
> > > > > > >> environment.
> > > > > > >> > I'm currently running the tests on my machine as well, just
> to
> > > > make
> > > > > > >> sure.
> > > > > > >> > I haven't ran the tests on OS X, maybe that's causing the
> > > issues.
> > > > > > >> >
> > > > > > >> > Can you send me (privately) the full output of the tests?
> > > > > > >> >
> > > > > > >> > Best,
> > > > > > >> > Robert
> > > > > > >> >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > > > [hidden email]>
> > > > > > >> wrote:
> > > > > > >> >
> > > > > > >> >> Hi Henry,
> > > > > > >> >>
> > > > > > >> >> running "mvn -DskipTests clean install" before "mvn clean
> > > > install"
> > > > > > did
> > > > > > >> not
> > > > > > >> >> fix the build for me.
> > > > > > >> >> The failing tests are also integration tests (*ITCase)
> which
> > > are
> > > > > only
> > > > > > >> >> executed in Maven's verify phase which is not triggered if
> > you
> > > > run
> > > > > > "mvn
> > > > > > >> >> clean test".
> > > > > > >> >> If I run "mvn test" without "mvn install" it fails for me
> as
> > > well
> > > > > > with
> > > > > > >> the
> > > > > > >> >> error you posted.
> > > > > > >> >>
> > > > > > >> >> So there seem to be at least two build issues with the
> > current
> > > > > > master.
> > > > > > >> >>
> > > > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> > > [hidden email]
> > > > >:
> > > > > > >> >>
> > > > > > >> >> > Hmm, I think there could be some weird dependencies to
> get
> > > the
> > > > > > Flink
> > > > > > >> >> > YARN uber jar.
> > > > > > >> >> >
> > > > > > >> >> > If you do "mvn clean install -DskipTests" then call "mvn
> > > test"
> > > > > all
> > > > > > >> the
> > > > > > >> >> > tests passed.
> > > > > > >> >> >
> > > > > > >> >> > But if you directly call "mvn clean test" then you see
> the
> > > > stack
> > > > > I
> > > > > > >> >> > have seen before.
> > > > > > >> >> >
> > > > > > >> >> > - Henry
> > > > > > >> >> >
> > > > > > >> >> >
> > > > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > > > >> [hidden email]
> > > > > > >> >> >
> > > > > > >> >> > wrote:
> > > > > > >> >> > > Did not see that trace but do see this:
> > > > > > >> >> > >
> > > > > > >> >> > > -------------------------------------------------------
> > > > > > >> >> > >
> > > > > > >> >> > >  T E S T S
> > > > > > >> >> > >
> > > > > > >> >> > > -------------------------------------------------------
> > > > > > >> >> > >
> > > > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > > > >> >> > >
> > > > > > >> >> > > log4j:WARN No such property [append] in
> > > > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > > > >> >> > >
> > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time
> > > > elapsed:
> > > > > > >> 0.476
> > > > > > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > > > > > >> >> > >
> > > > > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)
> Time
> > > > > > elapsed:
> > > > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > > > >> >> > >
> > > > > > >> >> > > java.lang.AssertionError: null
> > > > > > >> >> > >
> > > > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > > > >> >> > >
> > > > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > > > >> >> > >
> > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > > > > >> >> > >
> > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > > > > >> >> > >
> > > > > > >> >> > > at
> > > > > > >> >>
> > > > >
> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > > > >> >> > >
> > > > > > >> >> > >
> > > > > > >> >> > >
> > > > > > >> >> > > Results :
> > > > > > >> >> > >
> > > > > > >> >> > >
> > > > > > >> >> > > Failed tests:
> > > > > > >> >> > >
> > > > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > > > >> >> > >
> > > > > > >> >> > >
> > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > > > >> >> > >
> > > > > > >> >> > >
> > > > > > >> >> > > - Henry
> > > > > > >> >> > >
> > > > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > > > [hidden email]>
> > > > > > >> >> > wrote:
> > > > > > >> >> > >> Hi all,
> > > > > > >> >> > >>
> > > > > > >> >> > >> I tried to build the current master (mvn clean
> install)
> > > and
> > > > > some
> > > > > > >> >> tests
> > > > > > >> >> > in
> > > > > > >> >> > >> the flink-yarn-tests module fail:
> > > > > > >> >> > >>
> > > > > > >> >> > >> Failed tests:
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> > > > > > >> >> >
> > > > > > >> >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > > string
> > > > > did
> > > > > > >> not
> > > > > > >> >> > show up
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> > > > > > >> >>
> > > > > >
> > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > >> >> > >> There is at least one application on the cluster is
> not
> > > > > finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> > > > > > >> >> >
> > > > > > >> >>
> > > > > > >>
> > > > > >
> > > >
> > YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > > string
> > > > > did
> > > > > > >> not
> > > > > > >> >> > show up
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > There
> > > > > > >> is
> > > > > > >> >> at
> > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > >> >> > >>
> > > > > > >> >> > >>
> > > > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > > > > >> >> > >>
> > > > > > >> >> > >> Anybody else got this problem?
> > > > > > >> >> > >>
> > > > > > >> >> > >> Cheers, Fabian
> > > > > > >> >> >
> > > > > > >> >>
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
Its a 14.04 Ubuntu Server VM with 6GB Ram and a 6GB swap partition.

2015-01-25 13:00 GMT+01:00 Robert Metzger <[hidden email]>:

> Can you give me the exact version of the Ubuntu VM?
> Do you have a swapfile on the Ubuntu VM? The tests might currently allocate
> up to 8 GB of memory, so maybe your VM is starting to swap and thats why
> the test runs out of the timeout. (That would not explain the failure on
> OSX)
>
> I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one test
> failed.
>
> On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]> wrote:
>
> > My VM is configured with 6GB and the OS X host has 16GB. In both setups
> the
> > error was identical (with and without cleared .m2).
> > If the tests pass on a 3GB Travis host, I doubt that my errors are caused
> > by lack of memory.
> >
> > 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
> >
> > > I also had errors when running the tests in an Ubuntu virtual machine,
> > > caused by limited memory resources.
> > >
> > > Do you think its okay to assume that we have at least 3 GB of main
> memory
> > > available for running the tests? Thats what we have with Travis. The
> YARN
> > > tests are very memory intensive, because YARN itself has a bunch of
> > > services (resource manager, 2 node managers) and we allocate some
> > > containers there, which all need memory.
> > >
> > > The main problem is that the amount of memory per node manager is
> > > hard-coded to 4GB. I've already opened an issue in the Hadoop project
> and
> > > will fix the issue there...
> > >
> > > But I think I have some ideas how to work around the memory limitations
> > for
> > > now.
> > >
> > >
> > >
> > > On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> > > [hidden email]> wrote:
> > >
> > > > Hi,
> > > >
> > > > "mvn clean verify" fails for me on Ubuntu with deleted .m2
> repository.
> > > > I'm getting the following:
> > > >
> > > > Results :
> > > >
> > > > Failed tests:
> > > >
>  YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> > > null
> > > >
> > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> > > > null
> > > >
> > > > Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> > > >
> > > > -V.
> > > >
> > > > On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]>
> wrote:
> > > >
> > > > > The build fails also after the .m2 repository was deleted.
> > > > >
> > > > > Does anybody else have this problem?
> > > > >
> > > > > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> > > > >
> > > > > > Is this reproducible on a machine when you delete the
> > .m2/repository
> > > > > > directory (local maven cache) ?
> > > > > >
> > > > > > (I currently cannot try that because I am behind a rather
> > > low-bandwith
> > > > > > connection and would take very long to re-download all dependency
> > > > > > artifacts)
> > > > > >
> > > > > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <
> [hidden email]>
> > > > > wrote:
> > > > > >
> > > > > > > I just tried to build ("mvn clean install") on a fresh Ubuntu
> VM.
> > > > Fails
> > > > > > > with the same exception as natively on MacOS.
> > > > > > > Something strange is going on...
> > > > > > >
> > > > > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]>:
> > > > > > >
> > > > > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > > > > Will run the tests again and send you the output.
> > > > > > > >
> > > > > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <
> [hidden email]
> > >:
> > > > > > > >
> > > > > > > >> Okay, the tests have finished on my local machine, and they
> > > > passed.
> > > > > So
> > > > > > > it
> > > > > > > >> looks like an environment specific issue.
> > > > > > > >> Maybe the log helps me already to figure out whats the
> issue.
> > > > > > > >> We should make sure that our tests are passing on all
> > platforms
> > > ;)
> > > > > > > >>
> > > > > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > > > > [hidden email]
> > > > > > >
> > > > > > > >> wrote:
> > > > > > > >>
> > > > > > > >> > Hi,
> > > > > > > >> >
> > > > > > > >> > the tests are passing on travis. Maybe its a issue with
> your
> > > > > > > >> environment.
> > > > > > > >> > I'm currently running the tests on my machine as well,
> just
> > to
> > > > > make
> > > > > > > >> sure.
> > > > > > > >> > I haven't ran the tests on OS X, maybe that's causing the
> > > > issues.
> > > > > > > >> >
> > > > > > > >> > Can you send me (privately) the full output of the tests?
> > > > > > > >> >
> > > > > > > >> > Best,
> > > > > > > >> > Robert
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > > > > [hidden email]>
> > > > > > > >> wrote:
> > > > > > > >> >
> > > > > > > >> >> Hi Henry,
> > > > > > > >> >>
> > > > > > > >> >> running "mvn -DskipTests clean install" before "mvn clean
> > > > > install"
> > > > > > > did
> > > > > > > >> not
> > > > > > > >> >> fix the build for me.
> > > > > > > >> >> The failing tests are also integration tests (*ITCase)
> > which
> > > > are
> > > > > > only
> > > > > > > >> >> executed in Maven's verify phase which is not triggered
> if
> > > you
> > > > > run
> > > > > > > "mvn
> > > > > > > >> >> clean test".
> > > > > > > >> >> If I run "mvn test" without "mvn install" it fails for me
> > as
> > > > well
> > > > > > > with
> > > > > > > >> the
> > > > > > > >> >> error you posted.
> > > > > > > >> >>
> > > > > > > >> >> So there seem to be at least two build issues with the
> > > current
> > > > > > > master.
> > > > > > > >> >>
> > > > > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> > > > [hidden email]
> > > > > >:
> > > > > > > >> >>
> > > > > > > >> >> > Hmm, I think there could be some weird dependencies to
> > get
> > > > the
> > > > > > > Flink
> > > > > > > >> >> > YARN uber jar.
> > > > > > > >> >> >
> > > > > > > >> >> > If you do "mvn clean install -DskipTests" then call
> "mvn
> > > > test"
> > > > > > all
> > > > > > > >> the
> > > > > > > >> >> > tests passed.
> > > > > > > >> >> >
> > > > > > > >> >> > But if you directly call "mvn clean test" then you see
> > the
> > > > > stack
> > > > > > I
> > > > > > > >> >> > have seen before.
> > > > > > > >> >> >
> > > > > > > >> >> > - Henry
> > > > > > > >> >> >
> > > > > > > >> >> >
> > > > > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > > > > >> [hidden email]
> > > > > > > >> >> >
> > > > > > > >> >> > wrote:
> > > > > > > >> >> > > Did not see that trace but do see this:
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> -------------------------------------------------------
> > > > > > > >> >> > >
> > > > > > > >> >> > >  T E S T S
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> -------------------------------------------------------
> > > > > > > >> >> > >
> > > > > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > > > > >> >> > >
> > > > > > > >> >> > > log4j:WARN No such property [append] in
> > > > > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > > > > >> >> > >
> > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0,
> Time
> > > > > elapsed:
> > > > > > > >> 0.476
> > > > > > > >> >> > > sec <<< FAILURE! - in org.apache.flink.yarn.UtilsTest
> > > > > > > >> >> > >
> > > > > > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)
> > Time
> > > > > > > elapsed:
> > > > > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > > > > >> >> > >
> > > > > > > >> >> > > java.lang.AssertionError: null
> > > > > > > >> >> > >
> > > > > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > > > > >> >> > >
> > > > > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > > > > >> >> > >
> > > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > > > > > >> >> > >
> > > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > > > > > >> >> > >
> > > > > > > >> >> > > at
> > > > > > > >> >>
> > > > > >
> > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> > > > > > > >> >> > > Results :
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> > > > > > > >> >> > > Failed tests:
> > > > > > > >> >> > >
> > > > > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > > > > >> >> > >
> > > > > > > >> >> > >
> > > > > > > >> >> > > - Henry
> > > > > > > >> >> > >
> > > > > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > > > > [hidden email]>
> > > > > > > >> >> > wrote:
> > > > > > > >> >> > >> Hi all,
> > > > > > > >> >> > >>
> > > > > > > >> >> > >> I tried to build the current master (mvn clean
> > install)
> > > > and
> > > > > > some
> > > > > > > >> >> tests
> > > > > > > >> >> > in
> > > > > > > >> >> > >> the flink-yarn-tests module fail:
> > > > > > > >> >> > >>
> > > > > > > >> >> > >> Failed tests:
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > > > > > > >> >> >
> > > > > > > >> >>
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > > > string
> > > > > > did
> > > > > > > >> not
> > > > > > > >> >> > show up
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > > > > > > >> >>
> > > > > > >
> > > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > >> >> > >> There is at least one application on the cluster is
> > not
> > > > > > finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > > > > > > >> >> >
> > > > > > > >> >>
> > > > > > > >>
> > > > > > >
> > > > >
> > >
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > > > > >> >> > >> During the timeout period of 60 seconds the expected
> > > > string
> > > > > > did
> > > > > > > >> not
> > > > > > > >> >> > show up
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > There
> > > > > > > >> is
> > > > > > > >> >> at
> > > > > > > >> >> > >> least one application on the cluster is not finished
> > > > > > > >> >> > >>
> > > > > > > >> >> > >>
> > > > > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > > > > > >> >> > >>
> > > > > > > >> >> > >> Anybody else got this problem?
> > > > > > > >> >> > >>
> > > > > > > >> >> > >> Cheers, Fabian
> > > > > > > >> >> >
> > > > > > > >> >>
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
With the help of Fabian and Ufuk, I was able to identify the issue for OS
X. I already pushed the fix (see JIRA:
https://issues.apache.org/jira/browse/FLINK-1453).

Fabian is currently running the tests on the Ubuntu VM again. Lets see if
that one is fixed as well or if its a different issue.

On Sun, Jan 25, 2015 at 1:10 PM, Fabian Hueske <[hidden email]> wrote:

> Its a 14.04 Ubuntu Server VM with 6GB Ram and a 6GB swap partition.
>
> 2015-01-25 13:00 GMT+01:00 Robert Metzger <[hidden email]>:
>
> > Can you give me the exact version of the Ubuntu VM?
> > Do you have a swapfile on the Ubuntu VM? The tests might currently
> allocate
> > up to 8 GB of memory, so maybe your VM is starting to swap and thats why
> > the test runs out of the timeout. (That would not explain the failure on
> > OSX)
> >
> > I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one test
> > failed.
> >
> > On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]>
> wrote:
> >
> > > My VM is configured with 6GB and the OS X host has 16GB. In both setups
> > the
> > > error was identical (with and without cleared .m2).
> > > If the tests pass on a 3GB Travis host, I doubt that my errors are
> caused
> > > by lack of memory.
> > >
> > > 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
> > >
> > > > I also had errors when running the tests in an Ubuntu virtual
> machine,
> > > > caused by limited memory resources.
> > > >
> > > > Do you think its okay to assume that we have at least 3 GB of main
> > memory
> > > > available for running the tests? Thats what we have with Travis. The
> > YARN
> > > > tests are very memory intensive, because YARN itself has a bunch of
> > > > services (resource manager, 2 node managers) and we allocate some
> > > > containers there, which all need memory.
> > > >
> > > > The main problem is that the amount of memory per node manager is
> > > > hard-coded to 4GB. I've already opened an issue in the Hadoop project
> > and
> > > > will fix the issue there...
> > > >
> > > > But I think I have some ideas how to work around the memory
> limitations
> > > for
> > > > now.
> > > >
> > > >
> > > >
> > > > On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> > > > [hidden email]> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > "mvn clean verify" fails for me on Ubuntu with deleted .m2
> > repository.
> > > > > I'm getting the following:
> > > > >
> > > > > Results :
> > > > >
> > > > > Failed tests:
> > > > >
> >  YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> > > > null
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> > > > > null
> > > > >
> > > > > Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> > > > >
> > > > > -V.
> > > > >
> > > > > On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]>
> > wrote:
> > > > >
> > > > > > The build fails also after the .m2 repository was deleted.
> > > > > >
> > > > > > Does anybody else have this problem?
> > > > > >
> > > > > > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> > > > > >
> > > > > > > Is this reproducible on a machine when you delete the
> > > .m2/repository
> > > > > > > directory (local maven cache) ?
> > > > > > >
> > > > > > > (I currently cannot try that because I am behind a rather
> > > > low-bandwith
> > > > > > > connection and would take very long to re-download all
> dependency
> > > > > > > artifacts)
> > > > > > >
> > > > > > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <
> > [hidden email]>
> > > > > > wrote:
> > > > > > >
> > > > > > > > I just tried to build ("mvn clean install") on a fresh Ubuntu
> > VM.
> > > > > Fails
> > > > > > > > with the same exception as natively on MacOS.
> > > > > > > > Something strange is going on...
> > > > > > > >
> > > > > > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <[hidden email]
> >:
> > > > > > > >
> > > > > > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > > > > > Will run the tests again and send you the output.
> > > > > > > > >
> > > > > > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <
> > [hidden email]
> > > >:
> > > > > > > > >
> > > > > > > > >> Okay, the tests have finished on my local machine, and
> they
> > > > > passed.
> > > > > > So
> > > > > > > > it
> > > > > > > > >> looks like an environment specific issue.
> > > > > > > > >> Maybe the log helps me already to figure out whats the
> > issue.
> > > > > > > > >> We should make sure that our tests are passing on all
> > > platforms
> > > > ;)
> > > > > > > > >>
> > > > > > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > > > > > [hidden email]
> > > > > > > >
> > > > > > > > >> wrote:
> > > > > > > > >>
> > > > > > > > >> > Hi,
> > > > > > > > >> >
> > > > > > > > >> > the tests are passing on travis. Maybe its a issue with
> > your
> > > > > > > > >> environment.
> > > > > > > > >> > I'm currently running the tests on my machine as well,
> > just
> > > to
> > > > > > make
> > > > > > > > >> sure.
> > > > > > > > >> > I haven't ran the tests on OS X, maybe that's causing
> the
> > > > > issues.
> > > > > > > > >> >
> > > > > > > > >> > Can you send me (privately) the full output of the
> tests?
> > > > > > > > >> >
> > > > > > > > >> > Best,
> > > > > > > > >> > Robert
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > > > > > [hidden email]>
> > > > > > > > >> wrote:
> > > > > > > > >> >
> > > > > > > > >> >> Hi Henry,
> > > > > > > > >> >>
> > > > > > > > >> >> running "mvn -DskipTests clean install" before "mvn
> clean
> > > > > > install"
> > > > > > > > did
> > > > > > > > >> not
> > > > > > > > >> >> fix the build for me.
> > > > > > > > >> >> The failing tests are also integration tests (*ITCase)
> > > which
> > > > > are
> > > > > > > only
> > > > > > > > >> >> executed in Maven's verify phase which is not triggered
> > if
> > > > you
> > > > > > run
> > > > > > > > "mvn
> > > > > > > > >> >> clean test".
> > > > > > > > >> >> If I run "mvn test" without "mvn install" it fails for
> me
> > > as
> > > > > well
> > > > > > > > with
> > > > > > > > >> the
> > > > > > > > >> >> error you posted.
> > > > > > > > >> >>
> > > > > > > > >> >> So there seem to be at least two build issues with the
> > > > current
> > > > > > > > master.
> > > > > > > > >> >>
> > > > > > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> > > > > [hidden email]
> > > > > > >:
> > > > > > > > >> >>
> > > > > > > > >> >> > Hmm, I think there could be some weird dependencies
> to
> > > get
> > > > > the
> > > > > > > > Flink
> > > > > > > > >> >> > YARN uber jar.
> > > > > > > > >> >> >
> > > > > > > > >> >> > If you do "mvn clean install -DskipTests" then call
> > "mvn
> > > > > test"
> > > > > > > all
> > > > > > > > >> the
> > > > > > > > >> >> > tests passed.
> > > > > > > > >> >> >
> > > > > > > > >> >> > But if you directly call "mvn clean test" then you
> see
> > > the
> > > > > > stack
> > > > > > > I
> > > > > > > > >> >> > have seen before.
> > > > > > > > >> >> >
> > > > > > > > >> >> > - Henry
> > > > > > > > >> >> >
> > > > > > > > >> >> >
> > > > > > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > > > > > >> [hidden email]
> > > > > > > > >> >> >
> > > > > > > > >> >> > wrote:
> > > > > > > > >> >> > > Did not see that trace but do see this:
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > -------------------------------------------------------
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >  T E S T S
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > -------------------------------------------------------
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > log4j:WARN No such property [append] in
> > > > > > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0,
> > Time
> > > > > > elapsed:
> > > > > > > > >> 0.476
> > > > > > > > >> >> > > sec <<< FAILURE! - in
> org.apache.flink.yarn.UtilsTest
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > testUberjarLocator(org.apache.flink.yarn.UtilsTest)
> > > Time
> > > > > > > > elapsed:
> > > > > > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > java.lang.AssertionError: null
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:621)
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > at org.junit.Assert.assertNotNull(Assert.java:631)
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > at
> > > > > > > > >> >>
> > > > > > >
> > > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > Results :
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > Failed tests:
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > > > > > >> >> > >
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > - Henry
> > > > > > > > >> >> > >
> > > > > > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > > > > > [hidden email]>
> > > > > > > > >> >> > wrote:
> > > > > > > > >> >> > >> Hi all,
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >> I tried to build the current master (mvn clean
> > > install)
> > > > > and
> > > > > > > some
> > > > > > > > >> >> tests
> > > > > > > > >> >> > in
> > > > > > > > >> >> > >> the flink-yarn-tests module fail:
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >> Failed tests:
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > > > > > > >> >> >
> > > > > > > > >> >>
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > > > > > >> >> > >> During the timeout period of 60 seconds the
> expected
> > > > > string
> > > > > > > did
> > > > > > > > >> not
> > > > > > > > >> >> > show up
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > > > > > > >> >>
> > > > > > > >
> > > > YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > >> >> > >> There is at least one application on the cluster
> is
> > > not
> > > > > > > finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > > > > > > >> >> >
> > > > > > > > >> >>
> > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > > > > > >> >> > >> During the timeout period of 60 seconds the
> expected
> > > > > string
> > > > > > > did
> > > > > > > > >> not
> > > > > > > > >> >> > show up
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > There
> > > > > > > > >> is
> > > > > > > > >> >> at
> > > > > > > > >> >> > >> least one application on the cluster is not
> finished
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0, Skipped: 0
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >> Anybody else got this problem?
> > > > > > > > >> >> > >>
> > > > > > > > >> >> > >> Cheers, Fabian
> > > > > > > > >> >> >
> > > > > > > > >> >>
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Fabian Hueske-2
Robert, thanks for fixing the MacOS build!

Building on my Ubuntu VM is still failing though. Will send you the Maven
output.

Cheers, Fabian

2015-01-26 15:49 GMT+01:00 Robert Metzger <[hidden email]>:

> With the help of Fabian and Ufuk, I was able to identify the issue for OS
> X. I already pushed the fix (see JIRA:
> https://issues.apache.org/jira/browse/FLINK-1453).
>
> Fabian is currently running the tests on the Ubuntu VM again. Lets see if
> that one is fixed as well or if its a different issue.
>
> On Sun, Jan 25, 2015 at 1:10 PM, Fabian Hueske <[hidden email]> wrote:
>
> > Its a 14.04 Ubuntu Server VM with 6GB Ram and a 6GB swap partition.
> >
> > 2015-01-25 13:00 GMT+01:00 Robert Metzger <[hidden email]>:
> >
> > > Can you give me the exact version of the Ubuntu VM?
> > > Do you have a swapfile on the Ubuntu VM? The tests might currently
> > allocate
> > > up to 8 GB of memory, so maybe your VM is starting to swap and thats
> why
> > > the test runs out of the timeout. (That would not explain the failure
> on
> > > OSX)
> > >
> > > I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one
> test
> > > failed.
> > >
> > > On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]>
> > wrote:
> > >
> > > > My VM is configured with 6GB and the OS X host has 16GB. In both
> setups
> > > the
> > > > error was identical (with and without cleared .m2).
> > > > If the tests pass on a 3GB Travis host, I doubt that my errors are
> > caused
> > > > by lack of memory.
> > > >
> > > > 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
> > > >
> > > > > I also had errors when running the tests in an Ubuntu virtual
> > machine,
> > > > > caused by limited memory resources.
> > > > >
> > > > > Do you think its okay to assume that we have at least 3 GB of main
> > > memory
> > > > > available for running the tests? Thats what we have with Travis.
> The
> > > YARN
> > > > > tests are very memory intensive, because YARN itself has a bunch of
> > > > > services (resource manager, 2 node managers) and we allocate some
> > > > > containers there, which all need memory.
> > > > >
> > > > > The main problem is that the amount of memory per node manager is
> > > > > hard-coded to 4GB. I've already opened an issue in the Hadoop
> project
> > > and
> > > > > will fix the issue there...
> > > > >
> > > > > But I think I have some ideas how to work around the memory
> > limitations
> > > > for
> > > > > now.
> > > > >
> > > > >
> > > > >
> > > > > On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> > > > > [hidden email]> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > "mvn clean verify" fails for me on Ubuntu with deleted .m2
> > > repository.
> > > > > > I'm getting the following:
> > > > > >
> > > > > > Results :
> > > > > >
> > > > > > Failed tests:
> > > > > >
> > >  YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> > > > > null
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> > > > > > null
> > > > > >
> > > > > > Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> > > > > >
> > > > > > -V.
> > > > > >
> > > > > > On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]>
> > > wrote:
> > > > > >
> > > > > > > The build fails also after the .m2 repository was deleted.
> > > > > > >
> > > > > > > Does anybody else have this problem?
> > > > > > >
> > > > > > > 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> > > > > > >
> > > > > > > > Is this reproducible on a machine when you delete the
> > > > .m2/repository
> > > > > > > > directory (local maven cache) ?
> > > > > > > >
> > > > > > > > (I currently cannot try that because I am behind a rather
> > > > > low-bandwith
> > > > > > > > connection and would take very long to re-download all
> > dependency
> > > > > > > > artifacts)
> > > > > > > >
> > > > > > > > On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <
> > > [hidden email]>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > I just tried to build ("mvn clean install") on a fresh
> Ubuntu
> > > VM.
> > > > > > Fails
> > > > > > > > > with the same exception as natively on MacOS.
> > > > > > > > > Something strange is going on...
> > > > > > > > >
> > > > > > > > > 2015-01-24 11:19 GMT+01:00 Fabian Hueske <
> [hidden email]
> > >:
> > > > > > > > >
> > > > > > > > > > Thanks Robert! Sounds indeed like an environment problem.
> > > > > > > > > > Will run the tests again and send you the output.
> > > > > > > > > >
> > > > > > > > > > 2015-01-24 11:11 GMT+01:00 Robert Metzger <
> > > [hidden email]
> > > > >:
> > > > > > > > > >
> > > > > > > > > >> Okay, the tests have finished on my local machine, and
> > they
> > > > > > passed.
> > > > > > > So
> > > > > > > > > it
> > > > > > > > > >> looks like an environment specific issue.
> > > > > > > > > >> Maybe the log helps me already to figure out whats the
> > > issue.
> > > > > > > > > >> We should make sure that our tests are passing on all
> > > > platforms
> > > > > ;)
> > > > > > > > > >>
> > > > > > > > > >> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> > > > > > > [hidden email]
> > > > > > > > >
> > > > > > > > > >> wrote:
> > > > > > > > > >>
> > > > > > > > > >> > Hi,
> > > > > > > > > >> >
> > > > > > > > > >> > the tests are passing on travis. Maybe its a issue
> with
> > > your
> > > > > > > > > >> environment.
> > > > > > > > > >> > I'm currently running the tests on my machine as well,
> > > just
> > > > to
> > > > > > > make
> > > > > > > > > >> sure.
> > > > > > > > > >> > I haven't ran the tests on OS X, maybe that's causing
> > the
> > > > > > issues.
> > > > > > > > > >> >
> > > > > > > > > >> > Can you send me (privately) the full output of the
> > tests?
> > > > > > > > > >> >
> > > > > > > > > >> > Best,
> > > > > > > > > >> > Robert
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >> > On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> > > > > > > [hidden email]>
> > > > > > > > > >> wrote:
> > > > > > > > > >> >
> > > > > > > > > >> >> Hi Henry,
> > > > > > > > > >> >>
> > > > > > > > > >> >> running "mvn -DskipTests clean install" before "mvn
> > clean
> > > > > > > install"
> > > > > > > > > did
> > > > > > > > > >> not
> > > > > > > > > >> >> fix the build for me.
> > > > > > > > > >> >> The failing tests are also integration tests
> (*ITCase)
> > > > which
> > > > > > are
> > > > > > > > only
> > > > > > > > > >> >> executed in Maven's verify phase which is not
> triggered
> > > if
> > > > > you
> > > > > > > run
> > > > > > > > > "mvn
> > > > > > > > > >> >> clean test".
> > > > > > > > > >> >> If I run "mvn test" without "mvn install" it fails
> for
> > me
> > > > as
> > > > > > well
> > > > > > > > > with
> > > > > > > > > >> the
> > > > > > > > > >> >> error you posted.
> > > > > > > > > >> >>
> > > > > > > > > >> >> So there seem to be at least two build issues with
> the
> > > > > current
> > > > > > > > > master.
> > > > > > > > > >> >>
> > > > > > > > > >> >> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> > > > > > [hidden email]
> > > > > > > >:
> > > > > > > > > >> >>
> > > > > > > > > >> >> > Hmm, I think there could be some weird dependencies
> > to
> > > > get
> > > > > > the
> > > > > > > > > Flink
> > > > > > > > > >> >> > YARN uber jar.
> > > > > > > > > >> >> >
> > > > > > > > > >> >> > If you do "mvn clean install -DskipTests" then call
> > > "mvn
> > > > > > test"
> > > > > > > > all
> > > > > > > > > >> the
> > > > > > > > > >> >> > tests passed.
> > > > > > > > > >> >> >
> > > > > > > > > >> >> > But if you directly call "mvn clean test" then you
> > see
> > > > the
> > > > > > > stack
> > > > > > > > I
> > > > > > > > > >> >> > have seen before.
> > > > > > > > > >> >> >
> > > > > > > > > >> >> > - Henry
> > > > > > > > > >> >> >
> > > > > > > > > >> >> >
> > > > > > > > > >> >> > On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> > > > > > > > > >> [hidden email]
> > > > > > > > > >> >> >
> > > > > > > > > >> >> > wrote:
> > > > > > > > > >> >> > > Did not see that trace but do see this:
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > -------------------------------------------------------
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >  T E S T S
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > -------------------------------------------------------
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > Running org.apache.flink.yarn.UtilsTest
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > log4j:WARN No such property [append] in
> > > > > > > > > >> >> org.apache.log4j.ConsoleAppender.
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0,
> > > Time
> > > > > > > elapsed:
> > > > > > > > > >> 0.476
> > > > > > > > > >> >> > > sec <<< FAILURE! - in
> > org.apache.flink.yarn.UtilsTest
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> testUberjarLocator(org.apache.flink.yarn.UtilsTest)
> > > > Time
> > > > > > > > > elapsed:
> > > > > > > > > >> >> > > 0.405 sec  <<< FAILURE!
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > java.lang.AssertionError: null
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > at org.junit.Assert.fail(Assert.java:86)
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > at org.junit.Assert.assertTrue(Assert.java:41)
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > at
> org.junit.Assert.assertNotNull(Assert.java:621)
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > at
> org.junit.Assert.assertNotNull(Assert.java:631)
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > at
> > > > > > > > > >> >>
> > > > > > > >
> > > > org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > Results :
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > Failed tests:
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >   UtilsTest.testUberjarLocator:32 null
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > - Henry
> > > > > > > > > >> >> > >
> > > > > > > > > >> >> > > On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> > > > > > > > > [hidden email]>
> > > > > > > > > >> >> > wrote:
> > > > > > > > > >> >> > >> Hi all,
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >> I tried to build the current master (mvn clean
> > > > install)
> > > > > > and
> > > > > > > > some
> > > > > > > > > >> >> tests
> > > > > > > > > >> >> > in
> > > > > > > > > >> >> > >> the flink-yarn-tests module fail:
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >> Failed tests:
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> >
> > > > > > > > > >> >>
> > > > > > > > > >>
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> > > > > > > > > >> >> > >> During the timeout period of 60 seconds the
> > expected
> > > > > > string
> > > > > > > > did
> > > > > > > > > >> not
> > > > > > > > > >> >> > show up
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >>
> > > > > > > > >
> > > > >
> YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > > >> >> > >> There is at least one application on the cluster
> > is
> > > > not
> > > > > > > > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> >
> > > > > > > > > >> >>
> > > > > > > > > >>
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> > > > > > > > > >> >> > >> During the timeout period of 60 seconds the
> > expected
> > > > > > string
> > > > > > > > did
> > > > > > > > > >> not
> > > > > > > > > >> >> > show up
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > >  YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> > > > > > > > There
> > > > > > > > > >> is
> > > > > > > > > >> >> at
> > > > > > > > > >> >> > >> least one application on the cluster is not
> > finished
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >> Tests run: 10, Failures: 10, Errors: 0,
> Skipped: 0
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >> Anybody else got this problem?
> > > > > > > > > >> >> > >>
> > > > > > > > > >> >> > >> Cheers, Fabian
> > > > > > > > > >> >> >
> > > > > > > > > >> >>
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >>
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Ufuk Celebi-2
What's the state of this? I got an error, which I didn't see before: https://s3.amazonaws.com/archive.travis-ci.org/jobs/49194479/log.txt

On 27 Jan 2015, at 13:35, Fabian Hueske <[hidden email]> wrote:

> Robert, thanks for fixing the MacOS build!
>
> Building on my Ubuntu VM is still failing though. Will send you the Maven
> output.
>
> Cheers, Fabian
>
> 2015-01-26 15:49 GMT+01:00 Robert Metzger <[hidden email]>:
>
>> With the help of Fabian and Ufuk, I was able to identify the issue for OS
>> X. I already pushed the fix (see JIRA:
>> https://issues.apache.org/jira/browse/FLINK-1453).
>>
>> Fabian is currently running the tests on the Ubuntu VM again. Lets see if
>> that one is fixed as well or if its a different issue.
>>
>> On Sun, Jan 25, 2015 at 1:10 PM, Fabian Hueske <[hidden email]> wrote:
>>
>>> Its a 14.04 Ubuntu Server VM with 6GB Ram and a 6GB swap partition.
>>>
>>> 2015-01-25 13:00 GMT+01:00 Robert Metzger <[hidden email]>:
>>>
>>>> Can you give me the exact version of the Ubuntu VM?
>>>> Do you have a swapfile on the Ubuntu VM? The tests might currently
>>> allocate
>>>> up to 8 GB of memory, so maybe your VM is starting to swap and thats
>> why
>>>> the test runs out of the timeout. (That would not explain the failure
>> on
>>>> OSX)
>>>>
>>>> I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one
>> test
>>>> failed.
>>>>
>>>> On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]>
>>> wrote:
>>>>
>>>>> My VM is configured with 6GB and the OS X host has 16GB. In both
>> setups
>>>> the
>>>>> error was identical (with and without cleared .m2).
>>>>> If the tests pass on a 3GB Travis host, I doubt that my errors are
>>> caused
>>>>> by lack of memory.
>>>>>
>>>>> 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
>>>>>
>>>>>> I also had errors when running the tests in an Ubuntu virtual
>>> machine,
>>>>>> caused by limited memory resources.
>>>>>>
>>>>>> Do you think its okay to assume that we have at least 3 GB of main
>>>> memory
>>>>>> available for running the tests? Thats what we have with Travis.
>> The
>>>> YARN
>>>>>> tests are very memory intensive, because YARN itself has a bunch of
>>>>>> services (resource manager, 2 node managers) and we allocate some
>>>>>> containers there, which all need memory.
>>>>>>
>>>>>> The main problem is that the amount of memory per node manager is
>>>>>> hard-coded to 4GB. I've already opened an issue in the Hadoop
>> project
>>>> and
>>>>>> will fix the issue there...
>>>>>>
>>>>>> But I think I have some ideas how to work around the memory
>>> limitations
>>>>> for
>>>>>> now.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
>>>>>> [hidden email]> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> "mvn clean verify" fails for me on Ubuntu with deleted .m2
>>>> repository.
>>>>>>> I'm getting the following:
>>>>>>>
>>>>>>> Results :
>>>>>>>
>>>>>>> Failed tests:
>>>>>>>
>>>> YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
>>>>>> null
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
>>>>>>> null
>>>>>>>
>>>>>>> Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
>>>>>>>
>>>>>>> -V.
>>>>>>>
>>>>>>> On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]>
>>>> wrote:
>>>>>>>
>>>>>>>> The build fails also after the .m2 repository was deleted.
>>>>>>>>
>>>>>>>> Does anybody else have this problem?
>>>>>>>>
>>>>>>>> 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
>>>>>>>>
>>>>>>>>> Is this reproducible on a machine when you delete the
>>>>> .m2/repository
>>>>>>>>> directory (local maven cache) ?
>>>>>>>>>
>>>>>>>>> (I currently cannot try that because I am behind a rather
>>>>>> low-bandwith
>>>>>>>>> connection and would take very long to re-download all
>>> dependency
>>>>>>>>> artifacts)
>>>>>>>>>
>>>>>>>>> On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <
>>>> [hidden email]>
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> I just tried to build ("mvn clean install") on a fresh
>> Ubuntu
>>>> VM.
>>>>>>> Fails
>>>>>>>>>> with the same exception as natively on MacOS.
>>>>>>>>>> Something strange is going on...
>>>>>>>>>>
>>>>>>>>>> 2015-01-24 11:19 GMT+01:00 Fabian Hueske <
>> [hidden email]
>>>> :
>>>>>>>>>>
>>>>>>>>>>> Thanks Robert! Sounds indeed like an environment problem.
>>>>>>>>>>> Will run the tests again and send you the output.
>>>>>>>>>>>
>>>>>>>>>>> 2015-01-24 11:11 GMT+01:00 Robert Metzger <
>>>> [hidden email]
>>>>>> :
>>>>>>>>>>>
>>>>>>>>>>>> Okay, the tests have finished on my local machine, and
>>> they
>>>>>>> passed.
>>>>>>>> So
>>>>>>>>>> it
>>>>>>>>>>>> looks like an environment specific issue.
>>>>>>>>>>>> Maybe the log helps me already to figure out whats the
>>>> issue.
>>>>>>>>>>>> We should make sure that our tests are passing on all
>>>>> platforms
>>>>>> ;)
>>>>>>>>>>>>
>>>>>>>>>>>> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
>>>>>>>> [hidden email]
>>>>>>>>>>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>
>>>>>>>>>>>>> the tests are passing on travis. Maybe its a issue
>> with
>>>> your
>>>>>>>>>>>> environment.
>>>>>>>>>>>>> I'm currently running the tests on my machine as well,
>>>> just
>>>>> to
>>>>>>>> make
>>>>>>>>>>>> sure.
>>>>>>>>>>>>> I haven't ran the tests on OS X, maybe that's causing
>>> the
>>>>>>> issues.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Can you send me (privately) the full output of the
>>> tests?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best,
>>>>>>>>>>>>> Robert
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
>>>>>>>> [hidden email]>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Henry,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> running "mvn -DskipTests clean install" before "mvn
>>> clean
>>>>>>>> install"
>>>>>>>>>> did
>>>>>>>>>>>> not
>>>>>>>>>>>>>> fix the build for me.
>>>>>>>>>>>>>> The failing tests are also integration tests
>> (*ITCase)
>>>>> which
>>>>>>> are
>>>>>>>>> only
>>>>>>>>>>>>>> executed in Maven's verify phase which is not
>> triggered
>>>> if
>>>>>> you
>>>>>>>> run
>>>>>>>>>> "mvn
>>>>>>>>>>>>>> clean test".
>>>>>>>>>>>>>> If I run "mvn test" without "mvn install" it fails
>> for
>>> me
>>>>> as
>>>>>>> well
>>>>>>>>>> with
>>>>>>>>>>>> the
>>>>>>>>>>>>>> error you posted.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> So there seem to be at least two build issues with
>> the
>>>>>> current
>>>>>>>>>> master.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
>>>>>>> [hidden email]
>>>>>>>>> :
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hmm, I think there could be some weird dependencies
>>> to
>>>>> get
>>>>>>> the
>>>>>>>>>> Flink
>>>>>>>>>>>>>>> YARN uber jar.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> If you do "mvn clean install -DskipTests" then call
>>>> "mvn
>>>>>>> test"
>>>>>>>>> all
>>>>>>>>>>>> the
>>>>>>>>>>>>>>> tests passed.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> But if you directly call "mvn clean test" then you
>>> see
>>>>> the
>>>>>>>> stack
>>>>>>>>> I
>>>>>>>>>>>>>>> have seen before.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - Henry
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
>>>>>>>>>>>> [hidden email]
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>> Did not see that trace but do see this:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>> -------------------------------------------------------
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> T E S T S
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>> -------------------------------------------------------
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Running org.apache.flink.yarn.UtilsTest
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> log4j:WARN No such property [append] in
>>>>>>>>>>>>>> org.apache.log4j.ConsoleAppender.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0,
>>>> Time
>>>>>>>> elapsed:
>>>>>>>>>>>> 0.476
>>>>>>>>>>>>>>>> sec <<< FAILURE! - in
>>> org.apache.flink.yarn.UtilsTest
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>> testUberjarLocator(org.apache.flink.yarn.UtilsTest)
>>>>> Time
>>>>>>>>>> elapsed:
>>>>>>>>>>>>>>>> 0.405 sec  <<< FAILURE!
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> java.lang.AssertionError: null
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> at org.junit.Assert.fail(Assert.java:86)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> at org.junit.Assert.assertTrue(Assert.java:41)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> at
>> org.junit.Assert.assertNotNull(Assert.java:621)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> at
>> org.junit.Assert.assertNotNull(Assert.java:631)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>
>>>>>>>>>
>>>>> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Results :
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Failed tests:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>  UtilsTest.testUberjarLocator:32 null
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Henry
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
>>>>>>>>>> [hidden email]>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>> Hi all,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I tried to build the current master (mvn clean
>>>>> install)
>>>>>>> and
>>>>>>>>> some
>>>>>>>>>>>>>> tests
>>>>>>>>>>>>>>> in
>>>>>>>>>>>>>>>>> the flink-yarn-tests module fail:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Failed tests:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
>>>>>>>>>>>>>>>>> During the timeout period of 60 seconds the
>>> expected
>>>>>>> string
>>>>>>>>> did
>>>>>>>>>>>> not
>>>>>>>>>>>>>>> show up
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>
>> YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>>>>>>>>>> There is at least one application on the cluster
>>> is
>>>>> not
>>>>>>>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>
>> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
>>>>>>>>>>>>>>>>> During the timeout period of 60 seconds the
>>> expected
>>>>>>> string
>>>>>>>>> did
>>>>>>>>>>>> not
>>>>>>>>>>>>>>> show up
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
>>>>>>>>> There
>>>>>>>>>>>> is
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>> least one application on the cluster is not
>>> finished
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Tests run: 10, Failures: 10, Errors: 0,
>> Skipped: 0
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Anybody else got this problem?
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Cheers, Fabian
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: YARN ITCases fail, master broken?

Robert Metzger
is the error reproducible ?

There is certainly still an open issue with the YARN tests. I'll look into
this later this week.
Please let me know if this issue occurs frequently on Travis (I haven't
seen it yet in my tests)

On Mon, Feb 2, 2015 at 6:29 PM, Ufuk Celebi <[hidden email]> wrote:

> What's the state of this? I got an error, which I didn't see before:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/49194479/log.txt
>
> On 27 Jan 2015, at 13:35, Fabian Hueske <[hidden email]> wrote:
>
> > Robert, thanks for fixing the MacOS build!
> >
> > Building on my Ubuntu VM is still failing though. Will send you the Maven
> > output.
> >
> > Cheers, Fabian
> >
> > 2015-01-26 15:49 GMT+01:00 Robert Metzger <[hidden email]>:
> >
> >> With the help of Fabian and Ufuk, I was able to identify the issue for
> OS
> >> X. I already pushed the fix (see JIRA:
> >> https://issues.apache.org/jira/browse/FLINK-1453).
> >>
> >> Fabian is currently running the tests on the Ubuntu VM again. Lets see
> if
> >> that one is fixed as well or if its a different issue.
> >>
> >> On Sun, Jan 25, 2015 at 1:10 PM, Fabian Hueske <[hidden email]>
> wrote:
> >>
> >>> Its a 14.04 Ubuntu Server VM with 6GB Ram and a 6GB swap partition.
> >>>
> >>> 2015-01-25 13:00 GMT+01:00 Robert Metzger <[hidden email]>:
> >>>
> >>>> Can you give me the exact version of the Ubuntu VM?
> >>>> Do you have a swapfile on the Ubuntu VM? The tests might currently
> >>> allocate
> >>>> up to 8 GB of memory, so maybe your VM is starting to swap and thats
> >> why
> >>>> the test runs out of the timeout. (That would not explain the failure
> >> on
> >>>> OSX)
> >>>>
> >>>> I've tried it with a 3 GB (w/o swap file) 14.04 Ubuntu and only one
> >> test
> >>>> failed.
> >>>>
> >>>> On Sun, Jan 25, 2015 at 12:55 PM, Fabian Hueske <[hidden email]>
> >>> wrote:
> >>>>
> >>>>> My VM is configured with 6GB and the OS X host has 16GB. In both
> >> setups
> >>>> the
> >>>>> error was identical (with and without cleared .m2).
> >>>>> If the tests pass on a 3GB Travis host, I doubt that my errors are
> >>> caused
> >>>>> by lack of memory.
> >>>>>
> >>>>> 2015-01-25 12:28 GMT+01:00 Robert Metzger <[hidden email]>:
> >>>>>
> >>>>>> I also had errors when running the tests in an Ubuntu virtual
> >>> machine,
> >>>>>> caused by limited memory resources.
> >>>>>>
> >>>>>> Do you think its okay to assume that we have at least 3 GB of main
> >>>> memory
> >>>>>> available for running the tests? Thats what we have with Travis.
> >> The
> >>>> YARN
> >>>>>> tests are very memory intensive, because YARN itself has a bunch of
> >>>>>> services (resource manager, 2 node managers) and we allocate some
> >>>>>> containers there, which all need memory.
> >>>>>>
> >>>>>> The main problem is that the amount of memory per node manager is
> >>>>>> hard-coded to 4GB. I've already opened an issue in the Hadoop
> >> project
> >>>> and
> >>>>>> will fix the issue there...
> >>>>>>
> >>>>>> But I think I have some ideas how to work around the memory
> >>> limitations
> >>>>> for
> >>>>>> now.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Sat, Jan 24, 2015 at 11:47 PM, Vasiliki Kalavri <
> >>>>>> [hidden email]> wrote:
> >>>>>>
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> "mvn clean verify" fails for me on Ubuntu with deleted .m2
> >>>> repository.
> >>>>>>> I'm getting the following:
> >>>>>>>
> >>>>>>> Results :
> >>>>>>>
> >>>>>>> Failed tests:
> >>>>>>>
> >>>> YARNSessionFIFOITCase.setup:56->YarnTestBase.startYARNWithConfig:249
> >>>>>> null
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
> YARNSessionCapacitySchedulerITCase.setup:42->YarnTestBase.startYARNWithConfig:249
> >>>>>>> null
> >>>>>>>
> >>>>>>> Tests run: 2, Failures: 2, Errors: 0, Skipped: 0
> >>>>>>>
> >>>>>>> -V.
> >>>>>>>
> >>>>>>> On 24 January 2015 at 23:03, Fabian Hueske <[hidden email]>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> The build fails also after the .m2 repository was deleted.
> >>>>>>>>
> >>>>>>>> Does anybody else have this problem?
> >>>>>>>>
> >>>>>>>> 2015-01-24 21:31 GMT+01:00 Stephan Ewen <[hidden email]>:
> >>>>>>>>
> >>>>>>>>> Is this reproducible on a machine when you delete the
> >>>>> .m2/repository
> >>>>>>>>> directory (local maven cache) ?
> >>>>>>>>>
> >>>>>>>>> (I currently cannot try that because I am behind a rather
> >>>>>> low-bandwith
> >>>>>>>>> connection and would take very long to re-download all
> >>> dependency
> >>>>>>>>> artifacts)
> >>>>>>>>>
> >>>>>>>>> On Sat, Jan 24, 2015 at 5:54 AM, Fabian Hueske <
> >>>> [hidden email]>
> >>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> I just tried to build ("mvn clean install") on a fresh
> >> Ubuntu
> >>>> VM.
> >>>>>>> Fails
> >>>>>>>>>> with the same exception as natively on MacOS.
> >>>>>>>>>> Something strange is going on...
> >>>>>>>>>>
> >>>>>>>>>> 2015-01-24 11:19 GMT+01:00 Fabian Hueske <
> >> [hidden email]
> >>>> :
> >>>>>>>>>>
> >>>>>>>>>>> Thanks Robert! Sounds indeed like an environment problem.
> >>>>>>>>>>> Will run the tests again and send you the output.
> >>>>>>>>>>>
> >>>>>>>>>>> 2015-01-24 11:11 GMT+01:00 Robert Metzger <
> >>>> [hidden email]
> >>>>>> :
> >>>>>>>>>>>
> >>>>>>>>>>>> Okay, the tests have finished on my local machine, and
> >>> they
> >>>>>>> passed.
> >>>>>>>> So
> >>>>>>>>>> it
> >>>>>>>>>>>> looks like an environment specific issue.
> >>>>>>>>>>>> Maybe the log helps me already to figure out whats the
> >>>> issue.
> >>>>>>>>>>>> We should make sure that our tests are passing on all
> >>>>> platforms
> >>>>>> ;)
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Sat, Jan 24, 2015 at 11:06 AM, Robert Metzger <
> >>>>>>>> [hidden email]
> >>>>>>>>>>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Hi,
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> the tests are passing on travis. Maybe its a issue
> >> with
> >>>> your
> >>>>>>>>>>>> environment.
> >>>>>>>>>>>>> I'm currently running the tests on my machine as well,
> >>>> just
> >>>>> to
> >>>>>>>> make
> >>>>>>>>>>>> sure.
> >>>>>>>>>>>>> I haven't ran the tests on OS X, maybe that's causing
> >>> the
> >>>>>>> issues.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Can you send me (privately) the full output of the
> >>> tests?
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Best,
> >>>>>>>>>>>>> Robert
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sat, Jan 24, 2015 at 11:00 AM, Fabian Hueske <
> >>>>>>>> [hidden email]>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Hi Henry,
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> running "mvn -DskipTests clean install" before "mvn
> >>> clean
> >>>>>>>> install"
> >>>>>>>>>> did
> >>>>>>>>>>>> not
> >>>>>>>>>>>>>> fix the build for me.
> >>>>>>>>>>>>>> The failing tests are also integration tests
> >> (*ITCase)
> >>>>> which
> >>>>>>> are
> >>>>>>>>> only
> >>>>>>>>>>>>>> executed in Maven's verify phase which is not
> >> triggered
> >>>> if
> >>>>>> you
> >>>>>>>> run
> >>>>>>>>>> "mvn
> >>>>>>>>>>>>>> clean test".
> >>>>>>>>>>>>>> If I run "mvn test" without "mvn install" it fails
> >> for
> >>> me
> >>>>> as
> >>>>>>> well
> >>>>>>>>>> with
> >>>>>>>>>>>> the
> >>>>>>>>>>>>>> error you posted.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> So there seem to be at least two build issues with
> >> the
> >>>>>> current
> >>>>>>>>>> master.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> 2015-01-24 1:47 GMT+01:00 Henry Saputra <
> >>>>>>> [hidden email]
> >>>>>>>>> :
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Hmm, I think there could be some weird dependencies
> >>> to
> >>>>> get
> >>>>>>> the
> >>>>>>>>>> Flink
> >>>>>>>>>>>>>>> YARN uber jar.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> If you do "mvn clean install -DskipTests" then call
> >>>> "mvn
> >>>>>>> test"
> >>>>>>>>> all
> >>>>>>>>>>>> the
> >>>>>>>>>>>>>>> tests passed.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> But if you directly call "mvn clean test" then you
> >>> see
> >>>>> the
> >>>>>>>> stack
> >>>>>>>>> I
> >>>>>>>>>>>>>>> have seen before.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> - Henry
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Fri, Jan 23, 2015 at 3:35 PM, Henry Saputra <
> >>>>>>>>>>>> [hidden email]
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>> Did not see that trace but do see this:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>> -------------------------------------------------------
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> T E S T S
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>> -------------------------------------------------------
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Running org.apache.flink.yarn.UtilsTest
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> log4j:WARN No such property [append] in
> >>>>>>>>>>>>>> org.apache.log4j.ConsoleAppender.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0,
> >>>> Time
> >>>>>>>> elapsed:
> >>>>>>>>>>>> 0.476
> >>>>>>>>>>>>>>>> sec <<< FAILURE! - in
> >>> org.apache.flink.yarn.UtilsTest
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >> testUberjarLocator(org.apache.flink.yarn.UtilsTest)
> >>>>> Time
> >>>>>>>>>> elapsed:
> >>>>>>>>>>>>>>>> 0.405 sec  <<< FAILURE!
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> java.lang.AssertionError: null
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> at org.junit.Assert.fail(Assert.java:86)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> at org.junit.Assert.assertTrue(Assert.java:41)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> at
> >> org.junit.Assert.assertNotNull(Assert.java:621)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> at
> >> org.junit.Assert.assertNotNull(Assert.java:631)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>
> >>>>>>>>>
> >>>>> org.apache.flink.yarn.UtilsTest.testUberjarLocator(UtilsTest.java:32)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Results :
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Failed tests:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>  UtilsTest.testUberjarLocator:32 null
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Henry
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Fri, Jan 23, 2015 at 2:16 PM, Fabian Hueske <
> >>>>>>>>>> [hidden email]>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>> Hi all,
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> I tried to build the current master (mvn clean
> >>>>> install)
> >>>>>>> and
> >>>>>>>>> some
> >>>>>>>>>>>>>> tests
> >>>>>>>>>>>>>>> in
> >>>>>>>>>>>>>>>>> the flink-yarn-tests module fail:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Failed tests:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
> YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314
> >>>>>>>>>>>>>>>>> During the timeout period of 60 seconds the
> >>> expected
> >>>>>>> string
> >>>>>>>>> did
> >>>>>>>>>>>> not
> >>>>>>>>>>>>>>> show up
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>
> >> YARNSessionCapacitySchedulerITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>>>>>>>>>> There is at least one application on the cluster
> >>> is
> >>>>> not
> >>>>>>>>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>
> >>
> YARNSessionFIFOITCase.perJobYarnCluster:184->YarnTestBase.runWithArgs:314
> >>>>>>>>>>>>>>>>> During the timeout period of 60 seconds the
> >>> expected
> >>>>>>> string
> >>>>>>>>> did
> >>>>>>>>>>>> not
> >>>>>>>>>>>>>>> show up
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:146
> >>>>>>>>> There
> >>>>>>>>>>>> is
> >>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>> least one application on the cluster is not
> >>> finished
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Tests run: 10, Failures: 10, Errors: 0,
> >> Skipped: 0
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Anybody else got this problem?
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Cheers, Fabian
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>