Assertion Error in flink-test

[Matthias J. Sax]

Hi,

a recent build failed for me, due to an AssertionError:

> Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.479 sec <<< FAILURE! - in org.apache.flink.test.javaApiOperators.SumMinMaxITCase
> testGroupedAggregate[Execution mode = CLUSTER](org.apache.flink.test.javaApiOperators.SumMinMaxITCase) Time elapsed: 0.983 sec <<< FAILURE!
> java.lang.AssertionError: Different number of lines in expected and obtained result. expected:<6> but was:<3>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:270)
> at org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:256)
> at org.apache.flink.test.javaApiOperators.SumMinMaxITCase.after(SumMinMaxITCase.java:56)

Please see: https://travis-ci.org/mjsax/flink/jobs/67853420

Is this a knows issue? I never encountered this error before.


-Matthias

[Stephan Ewen]

Hi!

On Travis, there seems to be the weird issue that the file writing in the
tests is not completely reliable. Sometimes the test results are read from
incomplete/stale files.

I lazily try to migrate failed tests to using "collect()". This seems
reliable on Travis.

Cheers,
Stephan


On Tue, Jun 23, 2015 at 10:04 AM, Matthias J. Sax <
[hidden email]> wrote:

> Hi,
>
> a recent build failed for me, due to an AssertionError:
>
> > Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.479
> sec <<< FAILURE! - in org.apache.flink.test.javaApiOperators.SumMinMaxITCase
> > testGroupedAggregate[Execution mode =
> CLUSTER](org.apache.flink.test.javaApiOperators.SumMinMaxITCase) Time
> elapsed: 0.983 sec <<< FAILURE!
> > java.lang.AssertionError: Different number of lines in expected and
> obtained result. expected:<6> but was:<3>
> > at org.junit.Assert.fail(Assert.java:88)
> > at org.junit.Assert.failNotEquals(Assert.java:743)
> > at org.junit.Assert.assertEquals(Assert.java:118)
> > at org.junit.Assert.assertEquals(Assert.java:555)
> > at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:270)
> > at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:256)
> > at
> org.apache.flink.test.javaApiOperators.SumMinMaxITCase.after(SumMinMaxITCase.java:56)
>
> Please see: https://travis-ci.org/mjsax/flink/jobs/67853420
>
> Is this a knows issue? I never encountered this error before.
>
>
> -Matthias
>
>

... [show rest of quote]

[Matthias J. Sax]

Shall I provide a PR to fix this test using .collect()? JIRA?

-Matthias

On 06/23/2015 12:22 PM, Stephan Ewen wrote:

> Hi!
>
> On Travis, there seems to be the weird issue that the file writing in the
> tests is not completely reliable. Sometimes the test results are read from
> incomplete/stale files.
>
> I lazily try to migrate failed tests to using "collect()". This seems
> reliable on Travis.
>
> Cheers,
> Stephan
>
>
> On Tue, Jun 23, 2015 at 10:04 AM, Matthias J. Sax <
> [hidden email]> wrote:
>
>> Hi,
>>
>> a recent build failed for me, due to an AssertionError:
>>
>>> Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.479
>> sec <<< FAILURE! - in org.apache.flink.test.javaApiOperators.SumMinMaxITCase
>>> testGroupedAggregate[Execution mode =
>> CLUSTER](org.apache.flink.test.javaApiOperators.SumMinMaxITCase) Time
>> elapsed: 0.983 sec <<< FAILURE!
>>> java.lang.AssertionError: Different number of lines in expected and
>> obtained result. expected:<6> but was:<3>
>>> at org.junit.Assert.fail(Assert.java:88)
>>> at org.junit.Assert.failNotEquals(Assert.java:743)
>>> at org.junit.Assert.assertEquals(Assert.java:118)
>>> at org.junit.Assert.assertEquals(Assert.java:555)
>>> at
>> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:270)
>>> at
>> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:256)
>>> at
>> org.apache.flink.test.javaApiOperators.SumMinMaxITCase.after(SumMinMaxITCase.java:56)
>>
>> Please see: https://travis-ci.org/mjsax/flink/jobs/67853420
>>
>> Is this a knows issue? I never encountered this error before.
>>
>>
>> -Matthias
>>
>>
>

... [show rest of quote]

... [show rest of quote]

[mxm]

Yes, please go ahead.

On Tue, Jun 23, 2015 at 1:38 PM, Matthias J. Sax <
[hidden email]> wrote:

> Shall I provide a PR to fix this test using .collect()? JIRA?
>
> -Matthias
>
> On 06/23/2015 12:22 PM, Stephan Ewen wrote:
> > Hi!
> >
> > On Travis, there seems to be the weird issue that the file writing in the
> > tests is not completely reliable. Sometimes the test results are read
> from
> > incomplete/stale files.
> >
> > I lazily try to migrate failed tests to using "collect()". This seems
> > reliable on Travis.
> >
> > Cheers,
> > Stephan
> >
> >
> > On Tue, Jun 23, 2015 at 10:04 AM, Matthias J. Sax <
> > [hidden email]> wrote:
> >
> >> Hi,
> >>
> >> a recent build failed for me, due to an AssertionError:
> >>
> >>> Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.479
> >> sec <<< FAILURE! - in
> org.apache.flink.test.javaApiOperators.SumMinMaxITCase
> >>> testGroupedAggregate[Execution mode =
> >> CLUSTER](org.apache.flink.test.javaApiOperators.SumMinMaxITCase) Time
> >> elapsed: 0.983 sec <<< FAILURE!
> >>> java.lang.AssertionError: Different number of lines in expected and
> >> obtained result. expected:<6> but was:<3>
> >>> at org.junit.Assert.fail(Assert.java:88)
> >>> at org.junit.Assert.failNotEquals(Assert.java:743)
> >>> at org.junit.Assert.assertEquals(Assert.java:118)
> >>> at org.junit.Assert.assertEquals(Assert.java:555)
> >>> at
> >>
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:270)
> >>> at
> >>
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:256)
> >>> at
> >>
> org.apache.flink.test.javaApiOperators.SumMinMaxITCase.after(SumMinMaxITCase.java:56)
> >>
> >> Please see: https://travis-ci.org/mjsax/flink/jobs/67853420
> >>
> >> Is this a knows issue? I never encountered this error before.
> >>
> >>
> >> -Matthias
> >>
> >>
> >
>
>

... [show rest of quote]