E2E: Automatically mark test as flaky if previous failures are present
What does this MR do and why?
Fetches execution data and calculates pass_rate for specs and marks failed specs in merge request pipelines as flaky if pass rate is less than 98%. Also add pass rate argument to spec for easier evaluation of how flaky the spec is.
Screenshots or screen recordings
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Edited by Andrejs Cunskis