test: Retry e2e spec files once on failure
Description
This MR adds a retry to avoid flaky app behaviour causing E2E test failures. For example, occasionally the command pallette does not have the GitLab extension commands available immediately: #1473 (comment 2025330060)
This causes e2e spec failures with promptTitle
being undefined
after 15s:
GitLab Workflow Extension Authorization "before each" hook for GitLab Workflow Extension Authorization
[chrome 122.0.6261.156 linux #0-0] waitUntil condition failed with the following reason: Cannot read properties of undefined (reading 'includes')
Also:
- Improves assertion to consider
undefined
(although this does not fix the test itself) - One minor documentation update, to let people know about failure screenshots
Related Issues
How has this been tested?
pipeline
What CHANGELOG entry will this MR create?
-
fix:
Bug fix fixes - a user-facing issue in production - included in changelog -
feature:
New feature - a user-facing change which adds functionality - included in changelog -
BREAKING CHANGE:
(fix or feature that would cause existing functionality to change) - should bump major version, mentioned in the changelog -
None - other non-user-facing changes
Edited by Jay McCure