Skip to content

ci: Only retry once using rspec-retry

Rémy Coutable requested to merge retry-tests-only-once-with-rspec-retry into master

What does this MR do and why?

I noticed some weird behavior when retrying 3 times, compared to only retrying once, see !98451 (merged).

Pros

  • Retrying less times would lead to (very slightly) faster runtime
  • Spec that passes only on 4th try would not happen anymore. In other words, we would have detected !93135 (diffs, comment 1087409806) directly in the MR.

Cons

  • This could increase the number of flaky failures in #master-broken and MRs but I believe flaky spec should be detected with only one retry

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Rémy Coutable

Merge request reports