Skip to content

test: Retry e2e spec files once on failure

Jay McCure requested to merge jmc-auth-spec-e2e-fix into main

Description

This MR adds a retry to avoid flaky app behaviour causing E2E test failures. For example, occasionally the command pallette does not have the GitLab extension commands available immediately: #1473 (comment 2025330060)

This causes e2e spec failures with promptTitle being undefined after 15s:

GitLab Workflow Extension Authorization "before each" hook for GitLab Workflow Extension Authorization
[chrome 122.0.6261.156 linux #0-0] waitUntil condition failed with the following reason: Cannot read properties of undefined (reading 'includes')

Also:

  • Improves assertion to consider undefined (although this does not fix the test itself)
  • One minor documentation update, to let people know about failure screenshots

Related Issues

#1473 (closed)

How has this been tested?

pipeline

What CHANGELOG entry will this MR create?

  • fix: Bug fix fixes - a user-facing issue in production - included in changelog
  • feature: New feature - a user-facing change which adds functionality - included in changelog
  • BREAKING CHANGE: (fix or feature that would cause existing functionality to change) - should bump major version, mentioned in the changelog
  • None - other non-user-facing changes
Edited by Jay McCure

Merge request reports