[PSA] Please report all occurrences of test failures

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[PSA] Please report all occurrences of test failures

Aljoscha Krettek-2
Hi All,

we're currently struggling a bit with test stability, it seems
especially on Azure. If you encounter a test failure in a PR or anywhere
else, please take the time to check if there is already a Jira issue or
create a new one. If there is already an Issue, please report the
additional failure and also post a link to the log. This will help us
gauge which test-stability issues are still relevant or which need the
highest priority.

I usually use this JQL query to search for test failures:

  project = FLINK AND resolution = Unresolved AND summary ~
"FooBarTest*" ORDER BY priority DESC, updated DESC

I even have a Google Chrome search engine set up with that query and a
placeholder:

 
<a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20%20Unresolved%20AND%20summary%20~%20%22%s%22%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC">https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20%20Unresolved%20AND%20summary%20~%20%22%s%22%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC

You can set up a similar thing in Firefox and other browsers.

Best,
Aljoscha
Reply | Threaded
Open this post in threaded view
|

Re: [PSA] Please report all occurrences of test failures

Till Rohrmann
Thanks for this reminder Aljoscha. Big +1 for following this practice.

If you want to make the query a bit more generic (not only searching the
summary field), you could also use

project = FLINK AND resolution = Unresolved AND text ~ "FooBarTest*" ORDER
BY priority DESC, updated DESC

That way JIRA will search all text fields.

Cheers,
Till

On Fri, Apr 3, 2020 at 9:57 AM Aljoscha Krettek <[hidden email]> wrote:

> Hi All,
>
> we're currently struggling a bit with test stability, it seems
> especially on Azure. If you encounter a test failure in a PR or anywhere
> else, please take the time to check if there is already a Jira issue or
> create a new one. If there is already an Issue, please report the
> additional failure and also post a link to the log. This will help us
> gauge which test-stability issues are still relevant or which need the
> highest priority.
>
> I usually use this JQL query to search for test failures:
>
>   project = FLINK AND resolution = Unresolved AND summary ~
> "FooBarTest*" ORDER BY priority DESC, updated DESC
>
> I even have a Google Chrome search engine set up with that query and a
> placeholder:
>
>
>
> <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20%20Unresolved%20AND%20summary%20~%20%22%s%22%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC">https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20resolution%20%3D%20%20Unresolved%20AND%20summary%20~%20%22%s%22%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC
>
> You can set up a similar thing in Firefox and other browsers.
>
> Best,
> Aljoscha
>