Full pipelines are not run until code owners approvals are satisfied
Challenge
rspec
and jest
full jobs do not appear to be running in pipelines unless Code Owner approval is satisfied. This normally comes at the end of the MR and carries a risk of increasing rate of broken master due to the minimal transition success rate for rspec
. That success rate indicates that minimal pipelines will pass 5-30% of the time when the full pipeline fails.
Some of these failures are from flaky specs but we will see an increasing frequency of errors like #373054 (comment 1093402442) if there isn't anything done.
Proposal
- Run only full pipelines temporarily until impact is known
- Run only full
rspec
jobs - Re-configure minimal pipelines for Intelligent Test Selection in MR pipelines.