Skip to content

qa/qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb have unexpected effects on other QA tests

By looking at https://gitlab.com/gitlab-org/gitlab-qa/-/jobs/326373216, it seems qa/qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb can have unexpected effects on other QA tests:

Create
  File templates
D, [2019-10-21T09:52:11.657522 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: false
D, [2019-10-21T09:52:12.027661 #23] DEBUG -- : has_element? :login_page (wait: 60) returned: true
D, [2019-10-21T09:52:12.042376 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: false
D, [2019-10-21T09:52:12.205452 #23] DEBUG -- : has_element? :sign_in_tab (wait: 0) returned: true
D, [2019-10-21T09:52:12.205552 #23] DEBUG -- : clicking :sign_in_tab with args {}
D, [2019-10-21T09:52:12.205823 #23] DEBUG -- : finding :sign_in_tab with args {:text=>nil}
D, [2019-10-21T09:52:12.258054 #23] DEBUG -- : found :sign_in_tab
D, [2019-10-21T09:52:12.482666 #23] DEBUG -- : has_element? :standard_tab (wait: 0) returned: false
D, [2019-10-21T09:52:12.482826 #23] DEBUG -- : filling :login_field with "root"
D, [2019-10-21T09:52:12.482878 #23] DEBUG -- : finding :login_field with args {}
D, [2019-10-21T09:52:12.634985 #23] DEBUG -- : found :login_field
D, [2019-10-21T09:52:12.895337 #23] DEBUG -- : filling :password_field with "*****"
D, [2019-10-21T09:52:12.896844 #23] DEBUG -- : finding :password_field with args {}
D, [2019-10-21T09:52:12.973656 #23] DEBUG -- : found :password_field
D, [2019-10-21T09:52:13.133284 #23] DEBUG -- : clicking :sign_in_button , expecting to be at Class with args {}
D, [2019-10-21T09:52:13.133411 #23] DEBUG -- : finding :sign_in_button with args {:text=>nil}
D, [2019-10-21T09:52:13.172677 #23] DEBUG -- : found :sign_in_button
D, [2019-10-21T09:52:19.360011 #23] DEBUG -- : has_element? :navbar (wait: 60) returned: true
D, [2019-10-21T09:52:19.399232 #23] DEBUG -- : has_element? :user_avatar (wait: 60) returned: true
D, [2019-10-21T09:52:19.456082 #23] DEBUG -- : has_element? :user_menu (wait: 60) returned: true
D, [2019-10-21T09:52:19.506722 #23] DEBUG -- : has_element? :projects_dropdown (wait: 60) returned: true
D, [2019-10-21T09:52:19.556512 #23] DEBUG -- : has_element? :groups_dropdown (wait: 60) returned: true
D, [2019-10-21T09:52:19.593429 #23] DEBUG -- : has_element? :more_dropdown (wait: 60) returned: true
==> Built a QA::Resource::Sandbox via api in 0.389809598 seconds

==> Built a QA::Resource::Group via api in 0.739000384 seconds

==> Built a QA::Resource::Project via api in 3.440520798 seconds

D, [2019-10-21T09:52:23.042254 #23] DEBUG -- : within element :navbar
D, [2019-10-21T09:52:23.104617 #23] DEBUG -- : clicking :user_avatar with args {}
D, [2019-10-21T09:52:23.105501 #23] DEBUG -- : finding :user_avatar with args {:text=>nil}
D, [2019-10-21T09:52:23.371143 #23] DEBUG -- : found :user_avatar
D, [2019-10-21T09:52:23.873670 #23] DEBUG -- : within element :user_menu
D, [2019-10-21T09:52:24.215458 #23] DEBUG -- : clicking :sign_out_link with args {}
D, [2019-10-21T09:52:24.216065 #23] DEBUG -- : finding :sign_out_link with args {:text=>nil}
D, [2019-10-21T09:52:24.283414 #23] DEBUG -- : found :sign_out_link
D, [2019-10-21T09:52:25.557362 #23] DEBUG -- : end within element :user_menu
D, [2019-10-21T09:52:25.558396 #23] DEBUG -- : end within element :navbar
D, [2019-10-21T09:52:25.563291 #23] DEBUG -- : Starting test: Create File templates user adds LICENSE via file template Mozilla Public License 2.0
D, [2019-10-21T09:52:25.917874 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: false
D, [2019-10-21T09:52:27.181943 #23] DEBUG -- : has_element? :login_page (wait: 60) returned: true
D, [2019-10-21T09:52:27.204095 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: false
D, [2019-10-21T09:52:27.453004 #23] DEBUG -- : has_element? :sign_in_tab (wait: 0) returned: true
D, [2019-10-21T09:52:27.457761 #23] DEBUG -- : clicking :sign_in_tab with args {}
D, [2019-10-21T09:52:27.458876 #23] DEBUG -- : finding :sign_in_tab with args {:text=>nil}
D, [2019-10-21T09:52:27.511203 #23] DEBUG -- : found :sign_in_tab
D, [2019-10-21T09:52:27.919369 #23] DEBUG -- : has_element? :standard_tab (wait: 0) returned: false
D, [2019-10-21T09:52:27.920598 #23] DEBUG -- : filling :login_field with "root"
D, [2019-10-21T09:52:27.921325 #23] DEBUG -- : finding :login_field with args {}
D, [2019-10-21T09:52:28.132917 #23] DEBUG -- : found :login_field
D, [2019-10-21T09:52:28.563069 #23] DEBUG -- : filling :password_field with "*****"
D, [2019-10-21T09:52:28.563493 #23] DEBUG -- : finding :password_field with args {}
D, [2019-10-21T09:52:28.607242 #23] DEBUG -- : found :password_field
D, [2019-10-21T09:52:28.804223 #23] DEBUG -- : clicking :sign_in_button , expecting to be at Class with args {}
D, [2019-10-21T09:52:28.804364 #23] DEBUG -- : finding :sign_in_button with args {:text=>nil}
D, [2019-10-21T09:52:28.853497 #23] DEBUG -- : found :sign_in_button
D, [2019-10-21T09:52:30.042898 #23] DEBUG -- : has_element? :navbar (wait: 60) returned: true
D, [2019-10-21T09:52:30.103586 #23] DEBUG -- : has_element? :user_avatar (wait: 60) returned: true
D, [2019-10-21T09:52:30.164798 #23] DEBUG -- : has_element? :user_menu (wait: 60) returned: true
D, [2019-10-21T09:52:30.256017 #23] DEBUG -- : has_element? :projects_dropdown (wait: 60) returned: true
D, [2019-10-21T09:52:30.323555 #23] DEBUG -- : has_element? :groups_dropdown (wait: 60) returned: true
D, [2019-10-21T09:52:30.367236 #23] DEBUG -- : has_element? :more_dropdown (wait: 60) returned: true
D, [2019-10-21T09:52:31.989941 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:52:31.991092 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}
D, [2019-10-21T09:52:32.133089 #23] DEBUG -- : found :add_to_tree
D, [2019-10-21T09:52:32.319167 #23] DEBUG -- : clicking :new_file_option with args {}
D, [2019-10-21T09:52:32.319735 #23] DEBUG -- : finding :new_file_option with args {:text=>nil}
D, [2019-10-21T09:52:32.422327 #23] DEBUG -- : found :new_file_option
D, [2019-10-21T09:52:33.964118 #23] DEBUG -- : clicking :template_type_dropdown with args {}
D, [2019-10-21T09:52:33.965143 #23] DEBUG -- : finding :template_type_dropdown with args {:text=>nil}
D, [2019-10-21T09:52:34.067996 #23] DEBUG -- : found :template_type_dropdown
D, [2019-10-21T09:52:35.011052 #23] DEBUG -- : clicking :license_dropdown with args {}
D, [2019-10-21T09:52:35.012261 #23] DEBUG -- : finding :license_dropdown with args {:text=>nil}
D, [2019-10-21T09:52:35.079459 #23] DEBUG -- : found :license_dropdown
D, [2019-10-21T09:52:35.202314 #23] DEBUG -- : next wait uses reload: false
D, [2019-10-21T09:52:35.204134 #23] DEBUG -- : with wait: max 60; interval 0.1
D, [2019-10-21T09:52:35.265396 #23] DEBUG -- : ended wait after 0.059920345 seconds

1st Try error in ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55:
expected to find text "Mozilla Public License Version 2.0 ================================== 1. Definitions --------------" in "Skip to content Projects Groups More F file-template-project-1fc8d9597e7593c4 Project Repository Files Commits Branches Tags Contributors Graph Compare Charts Locked Files Issues 0 Merge Requests 0 CI / CD Security & Compliance Operations Packages Wiki Snippets Settings Collapse sidebar gitlab-qa-sandbox-group qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60 file-template-project-1fc8d9597e7593c4 Repository New file master / Select a template type Apply a template Soft wrap text 1 Commit message Add new file Target Branch Commit changes Cancel"
Timed out waiting for Selenium session reset

RSpec::Retry: 2nd try ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55
D, [2019-10-21T09:52:57.171534 #23] DEBUG -- : Starting test: Create File templates user adds LICENSE via file template Mozilla Public License 2.0
D, [2019-10-21T09:52:57.278573 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:52:57.283641 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:52:57.283794 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}
    user adds LICENSE via file template Mozilla Public License 2.0 (FAILED - 1)
  HTML screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-52-57.295.html
  Image screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-52-57.295.png
D, [2019-10-21T09:53:08.028010 #23] DEBUG -- : Starting test: Create File templates user adds .gitignore via file template Android
D, [2019-10-21T09:53:08.134027 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:53:08.141208 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:53:08.141325 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}

1st Try error in ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55:
unexpected alert open: {Alert text : }
  (Session info: headless chrome=77.0.3865.120)
Timed out waiting for Selenium session reset

RSpec::Retry: 2nd try ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55
D, [2019-10-21T09:53:18.736734 #23] DEBUG -- : Starting test: Create File templates user adds .gitignore via file template Android
D, [2019-10-21T09:53:18.804774 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:53:18.809806 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:53:18.810274 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}
    user adds .gitignore via file template Android (FAILED - 2)
  HTML screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-53-18.821.html
  Image screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-53-18.821.png
D, [2019-10-21T09:53:29.416129 #23] DEBUG -- : Starting test: Create File templates user adds .gitlab-ci.yml via file template Julia
D, [2019-10-21T09:53:29.513436 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:53:29.518385 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:53:29.518598 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}

1st Try error in ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55:
unexpected alert open: {Alert text : }
  (Session info: headless chrome=77.0.3865.120)
Timed out waiting for Selenium session reset

RSpec::Retry: 2nd try ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55
D, [2019-10-21T09:53:40.120288 #23] DEBUG -- : Starting test: Create File templates user adds .gitlab-ci.yml via file template Julia
D, [2019-10-21T09:53:40.340155 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:53:40.345894 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:53:40.346014 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}
    user adds .gitlab-ci.yml via file template Julia (FAILED - 3)
  HTML screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-53-40.359.html
  Image screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-53-40.359.png
D, [2019-10-21T09:53:50.960865 #23] DEBUG -- : Starting test: Create File templates user adds Dockerfile via file template Python
D, [2019-10-21T09:53:51.089023 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:53:51.094623 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:53:51.094849 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}

1st Try error in ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55:
unexpected alert open: {Alert text : }
  (Session info: headless chrome=77.0.3865.120)
Timed out waiting for Selenium session reset

RSpec::Retry: 2nd try ./qa/specs/features/browser_ui/3_create/repository/add_file_template_spec.rb:55
D, [2019-10-21T09:54:01.715387 #23] DEBUG -- : Starting test: Create File templates user adds Dockerfile via file template Python
D, [2019-10-21T09:54:01.799221 #23] DEBUG -- : has_element? :user_avatar (wait: 0) returned: true
D, [2019-10-21T09:54:01.810805 #23] DEBUG -- : clicking :add_to_tree with args {}
D, [2019-10-21T09:54:01.810917 #23] DEBUG -- : finding :add_to_tree with args {:text=>nil}
    user adds Dockerfile via file template Python (FAILED - 4)
  HTML screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-54-01.823.html
  Image screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/browser_ui/3_create/repository/add_file_template_spec.rb_2019-10-21-09-54-01.823.png

Plan
  Group issue boards
D, [2019-10-21T09:54:12.408839 #23] DEBUG -- : Starting test: Plan Group issue boards creates a group issue board via the GUI

1st Try error in ./qa/specs/features/ee/browser_ui/2_plan/issue_boards/create_group_issue_board_spec.rb:21:
unexpected alert open: {Alert text : }
  (Session info: headless chrome=77.0.3865.120)
Timed out waiting for Selenium session reset

RSpec::Retry: 2nd try ./qa/specs/features/ee/browser_ui/2_plan/issue_boards/create_group_issue_board_spec.rb:21
D, [2019-10-21T09:54:23.105088 #23] DEBUG -- : Starting test: Plan Group issue boards creates a group issue board via the GUI
    creates a group issue board via the GUI (FAILED - 5)
  HTML screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/ee/browser_ui/2_plan/issue_boards/create_group_issue_board_spec.rb_2019-10-21-09-54-23.124.html
  Image screenshot: file:///home/gitlab/qa/tmp/qa-test-2019-10-21-09-46-41-bcf12ee7a6f24d60/ee/browser_ui/2_plan/issue_boards/create_group_issue_board_spec.rb_2019-10-21-09-54-23.124.png

The first screenshot is as follows:

add_file_template_spec.rb_2019-10-21-09-52-46.476

But then the screenshot for unrelated tests (e.g. qa/specs/features/ee/browser_ui/2_plan/issue_boards/create_group_issue_board_spec.rb:21) shows the same:

create_group_issue_board_spec.rb_2019-10-21-09-54-23.124

Note that the logs mention unexpected alert open: {Alert text : }, and we can see an informative box at the bottom left of the first screenshot. That may be related, or not.

Retrying the job makes it pass: https://gitlab.com/gitlab-org/gitlab-qa/-/jobs/326516716