Skip to content

Failures in several LFS Geo E2E tests

Summary

https://gitlab.com/gitlab-org/gitlab-qa/-/jobs/487434773

 Failed examples:
 rspec ./qa/specs/features/ee/browser_ui/geo/http_push_spec.rb:63 # Geo GitLab HTTP push git-lfs commit is replicated to the secondary
 rspec ./qa/specs/features/ee/browser_ui/geo/ssh_push_spec.rb:78 # Geo GitLab SSH push git-lfs commit is replicated to the secondary
 rspec ./qa/specs/features/ee/browser_ui/geo/ssh_push_to_secondary_spec.rb:99 # Geo GitLab SSH push to secondary git-lfs commit is proxied to the primary and ultimately replicated to the secondary
 rspec ./qa/specs/features/ee/browser_ui/geo/http_push_to_secondary_spec.rb:92 # Geo GitLab Geo HTTP push secondary git-lfs commit is redirected to the primary and ultimately replicated to the secondary

Found in an MR that made an unrelated change (!27918 (merged)) so I assume it's a transient failure because it looks like the tests are passing in master (and previously passed in the MR too).

Stack trace

 Failures:
   1) Geo GitLab HTTP push git-lfs commit is replicated to the secondary
      Failure/Error:
        push = Resource::Repository::ProjectPush.fabricate! do |push|
          push.use_lfs = true
          push.project = project
          push.file_name = file_name
          push.file_content = "# #{file_content}"
          push.commit_message = 'Add README.md'
        end
      
      QA::Git::Repository::RepositoryCommandError:
        The command HOME="/tmp/qa-netrc-credentials/22" git push http://root@gitlab-primary.geo/gitlab-qa-sandbox-group/qa-test-2020-03-26-21-17-04-8b3bd71c444e9128/geo-project-071aff913028e76f.git master:master 2>&1 failed (1) with the following output:
        Locking support detected on remote "http://root@gitlab-primary.geo/gitlab-qa-sandbox-group/qa-test-2020-03-26-21-17-04-8b3bd71c444e9128/geo-project-071aff913028e76f.git". Consider enabling it with:
          $ git config lfs.http://root@gitlab-primary.geo/gitlab-qa-sandbox-group/qa-test-2020-03-26-21-17-04-8b3bd71c444e9128/geo-project-071aff913028e76f.git/info/lfs.locksverify true
        LFS: Access forbidden. Check your access level.
        error: failed to push some refs to 'http://root@gitlab-primary.geo/gitlab-qa-sandbox-group/qa-test-2020-03-26-21-17-04-8b3bd71c444e9128/geo-project-071aff913028e76f.git'
      # ./qa/git/repository.rb:221:in `run'
      # ./qa/git/repository.rb:116:in `push_changes'
      # ./qa/resource/repository/push.rb:98:in `block in fabricate!'
      # ./qa/scenario/actable.rb:16:in `perform'
      # ./qa/git/repository.rb:33:in `block (2 levels) in perform'
      # ./qa/git/repository.rb:33:in `chdir'
      # ./qa/git/repository.rb:33:in `block in perform'
      # ./qa/git/repository.rb:32:in `perform'
      # ./qa/resource/repository/push.rb:50:in `fabricate!'
      # ./qa/resource/repository/project_push.rb:38:in `fabricate!'
      # ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
      # ./qa/resource/base.rb:135:in `log_fabrication'
      # ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
      # ./qa/resource/base.rb:118:in `do_fabricate!'
      # ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
      # ./qa/resource/base.rb:21:in `rescue in fabricate!'
      # ./qa/resource/base.rb:18:in `fabricate!'
      # ./qa/specs/features/ee/browser_ui/geo/http_push_spec.rb:75:in `block (5 levels) in <module:QA>'
      # ./qa/flow/login.rb:13:in `while_signed_in'
      # ./qa/specs/features/ee/browser_ui/geo/http_push_spec.rb:68:in `block (4 levels) in <module:QA>'

Screenshot / HTML page

Screenshots are not relevant because the issue is with LFS access. The screenshots just show the projects dashboard.

Possible fixes

/cc @jennielouie