'Run QA tests against your GDK setup' page needs an update
When attempting to run examples listed in https://gitlab.com/gitlab-org/gitlab-qa/blob/master/docs/run_qa_against_gdk.md I see various errors:
Issue 1
Using example:
bin/qa Test::Instance::Any CE http://192.168.0.12:3000 -- qa/specs/features/repository/protected_branches_spec.rb:30
-
Test::Instance::Any
doesn't appear to exist. Should beTest::Instance::All
? - The
CE
portion causes aLoadError
-
qa/specs/features/repository/protected_branches_spec.rb
no longer exists. Should beqa/specs/features/browser_ui/3_create/repository/push_protected_branch_spec.rb
?
Interestingly, the following example does seem to execute (when the spec filename is corrected to qa/specs/features/browser_ui/3_create/repository/push_protected_branch_spec.rb
):
gitlab-qa Test::Instance::Any CE http://192.168.0.12:3000 -- qa/specs/features/browser_ui/3_create/repository/push_protected_branch_spec.rb
Issue 2
The doc suggests runn bin/qa ...
but when running the Geo scenarios, I get the following error:
26) geo Geo Nodes API Geo Nodes API on secondary node repairing a Geo node POST /geo_nodes/:id/repair for an invalid node
Failure/Error: api_client = Runtime::API::Client.new(:geo_primary)
LoadError:
cannot load such file -- airborne
# ./qa/runtime/api/client.rb:1:in `<top (required)>'
# ./qa/specs/features/api/ee_geo/geo_nodes_spec.rb:231:in `get_personal_access_token'
# ./qa/specs/features/api/ee_geo/geo_nodes_spec.rb:7:in `block (3 levels) in <module:QA>'
# ./qa/specs/runner.rb:28:in `perform'
# ./qa/scenario/template.rb:8:in `block in perform'
# ./qa/scenario/template.rb:6:in `tap'
# ./qa/scenario/template.rb:6:in `perform'
# ./qa/ee/scenario/test/geo.rb:33:in `perform'
# ./qa/scenario/template.rb:8:in `block in perform'
# ./qa/scenario/template.rb:6:in `tap'
# ./qa/scenario/template.rb:6:in `perform'
# ./qa/scenario/bootable.rb:26:in `launch!'
The airborne
gem is defined within qa/Gemfile
, so just looks like we need to run bundle exec bin/qa
instead. Bit of a nitpick, but nowhere does it actually say to cd qa
either, probably worth adding an explicit command for that.
Am running gitlab-qa
version 2.3.0