Skip to content

E2E: Update reliable spec report creation

Andrejs Cunskis requested to merge acunskis-reliable-report into master

What does this MR do and why?

Describe in detail what your merge request does and why.

  • Fetch data from multiple run types to make sure test is stable on all environments
  • Create one report issue for stable specs and reliable specs with failures
  • Post only summary tables to slack and link to report issue

Related issue: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/994

Screenshots or screen recordings

Example report: #347413 (closed)

Running locally

bundle exec rake reliable_spec_report

Bear minimum, command requires following variables:

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Andrejs Cunskis

Merge request reports

Loading