Add Browser level test Sentry and Kibana logs when 500 error is found
What does this MR do and why?
Logs Sentry and Kibana URLs on Browser tests if we find a 500 error.
This builds upon @sgregory2 's work on logging API errors with Sentry links ( !81927 (closed) )
As per team task https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/1130
Describe in detail what your merge request does and why.
Screenshots or screen recordings
These are strongly recommended to assist reviewers and reduce the time to merge your change.
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
- Download the contrived end to end test example from fabbb08b
- Run against local - no log URLs shown
- Run against Staging - log URLs shown of the form
1) Secure TEst failures Failure fails due to 500
Failure/Error: expect(push_rules).not_to have_element(:create_tag_button)
RuntimeError:
Error Code 500
There were 3 SEVERE level errors:
["https://staging.gitlab.com/admin/subscription - Clear-Site-Data header on 'https://staging.gitlab.com/users/sign_out': Unrecognized type: \"*\".", "https://staging.gitlab.com/admin/subscription - Clear-Site-Data header on 'https://staging.gitlab.com/users/sign_out': No recognized types specified.", "https://staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2022-03-07-13-17-22-1611b7ac7cb63ae2/project-with-secure-c119625ccbb22a6b/-/push_rules/6619119 - Failed to load resource: the server responded with a status of 500 ()"]
Path: /gitlab-qa-sandbox-group/qa-test-2022-03-07-13-17-22-1611b7ac7cb63ae2/project-with-secure-c119625ccbb22a6b/-/push_rules/6619119
Correlation Id: 01FXJ8ECEN9XQ8RPKWV548JR2B
Sentry Url: https://sentry.gitlab.net/gitlab/staginggitlabcom/?environment=gstg&query=correlation_id%3A%2201FXJ8ECEN9XQ8RPKWV548JR2B%22
Kibana Url: https://nonprod-log.gitlab.net/app/discover#/?_a=(query:(language:kuery,query:'json.correlation_id%20:%2001FXJ8ECEN9XQ8RPKWV548JR2B'))
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Edited by Will Meek