Skip to content

E2E: Automatically mark test as flaky if previous failures are present

Andrejs Cunskis requested to merge acunskis-mark-flaky-tests into master

What does this MR do and why?

Fetches execution data and calculates pass_rate for specs and marks failed specs in merge request pipelines as flaky if pass rate is less than 98%. Also add pass rate argument to spec for easier evaluation of how flaky the spec is.

Screenshots or screen recordings

Failures list: image

Single spec: image

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Andrejs Cunskis

Merge request reports

Loading