Skip to content

Draft: Do not run reliable tests as part of review-qa-all jobs

Andrejs Cunskis requested to merge acunskis-review-qa-reduce-duplication into master

What does this MR do and why?

Describe in detail what your merge request does and why.

Currently, review-qa-all jobs also run smoke and reliable scenarios which are executed in smoke and reliable jobs already. This means we are executing 73 specs twice per one pipeline run:

  • Do not run reliable tests in review-qa-all jobs
  • Combine reliable and smoke results in same allure report since these jobs are always executed

Once reliable tests become mandatory, we could check if smoke tests can be promoted to reliable in order to exclude smoke tests from review-qa-all execution because rspec doesn't allow to exclude multiple tags with or condition (reliable || smoke)

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Andrejs Cunskis

Merge request reports