Repositores are not included in application backup
Summary
The sudo gitlab-rake gitlab:backup:create
command is unable to dump repositories (they are always marked as [SKIPPED]) due to the No such file or directory
errors thrown by /opt/gitlab/embedded/bin/git --git-dir=/var/opt/gitlab/git-data/repositories/@hashed/45/23/hash_here.git bundle create /var/opt/gitlab/backups/repositories/@hashed/45/23/hash_here.bundle --all
commands.
This happened to me on gitlab-ce 10.0.2 06a5a33
and still bugged for me after upgrade to 10.1.0 5a695c4
.
My /etc/gitlab/gitlab.rb
contains changes related to:
- external_url;
- nginx (SSL +
custom_gitlab_server_config
to support Let's Encrypt); - SMTP configuration;
- S3 configuration for backups uploading (but this error occurs even without this configuration);
- omniauth configuration for github, bitbucket & gitlab.com.
Everything else in this file was not touched since initial installation of gitlab-ce (version 10.0.1 if I remember correctly).
Steps to reproduce
Run sudo gitlab-rake gitlab:backup:create
command.
What is the current bug behavior?
Backup archive created but repositories
directory contains only namespaces sub-directories without actual repositories and its files (example: empty repositories/ArgentCrusade/packages
directory, without concrete repositories subfolders in it).
Archive size is about 160 kb.
What is the expected correct behavior?
Backup archive should be created with all repositories' files.
Relevant logs and/or screenshots
I've removed repeated warnings about No such file or directory
since they are displayed for all repositories and differences are only in repositories names & hashes.
Also I've replaced full repository hash with hash_here
, since I'm not sure if full hash can lead into any vulnerabilities.
root@localhost:/# sudo gitlab-rake gitlab:backup:create
Dumping database ...
Dumping PostgreSQL database gitlabhq_production ... [DONE]
done
Dumping repositories ...
* ArgentCrusade/packages/forms ... [WARNING] Executing /opt/gitlab/embedded/bin/git --git-dir=/var/opt/gitlab/git-data/repositories/@hashed/4f/c8/hash_here.git bundle create /var/opt/gitlab/backups/repositories/@hashed/4f/c8/hash_here.bundle --all
Ignoring error on ArgentCrusade/packages/forms - fatal: Unable to create '/var/opt/gitlab/backups/repositories/@hashed/4f/c8/hash_here.bundle.lock': No such file or directory
* ArgentCrusade/packages/forms.wiki ... [SKIPPED]
* ArgentCrusade/packages/seo ... [WARNING] Executing /opt/gitlab/embedded/bin/git --git-dir=/var/opt/gitlab/git-data/repositories/@hashed/4e/c9/hash_here.git bundle create /var/opt/gitlab/backups/repositories/@hashed/4e/c9/hash_here.bundle --all
Ignoring error on ArgentCrusade/packages/seo - fatal: Unable to create '/var/opt/gitlab/backups/repositories/@hashed/4e/c9/hash_here.bundle.lock': No such file or directory
* ArgentCrusade/packages/seo.wiki ... [SKIPPED]
done
Dumping uploads ...
done
Dumping builds ...
done
Dumping artifacts ...
done
Dumping pages ...
done
Dumping lfs objects ...
done
Dumping container registry images ...
[DISABLED]
Creating backup archive: 1509208517_2017_10_28_10.1.0_gitlab_backup.tar ... done
Uploading backup archive to remote storage argentcrusade-gitlab ... done
Deleting tmp directories ... done
done
done
done
done
done
done
done
Deleting old backups ... skipping
Output of checks
Results of GitLab environment info
Expand for output related to GitLab environment info
root@localhost:/# sudo gitlab-rake gitlab:env:infoSystem information System: Ubuntu 16.04 Current User: git Using RVM: no Ruby Version: 2.3.5p376 Gem Version: 2.6.13 Bundler Version:1.13.7 Rake Version: 12.1.0 Redis Version: 3.2.5 Git Version: 2.13.5 Sidekiq Version:5.0.4 Go Version: unknown
GitLab information Version: 10.1.0 Revision: 5a695c4 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: postgresql URL: https://gitlab.argentcrusade.ru HTTP Clone URL: https://gitlab.argentcrusade.ru/some-group/some-project.git SSH Clone URL: git@gitlab.argentcrusade.ru:some-group/some-project.git Using LDAP: no Using Omniauth: yes Omniauth Providers: github, gitlab, bitbucket
GitLab Shell Version: 5.9.3 Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks Git: /opt/gitlab/embedded/bin/git
Results of GitLab application Check
Expand for output related to the GitLab application check
root@localhost:/# sudo gitlab-rake gitlab:check SANITIZE=true Checking GitLab Shell ...GitLab Shell version >= 5.9.3 ? ... OK (5.9.3) Repo base directory exists? default... yes Repo storage directories are symlinks? default... no Repo paths owned by git:root, or git:git? default... yes Repo paths access is drwxrws---? default... yes hooks directories in repos are links: ... 3/3 ... ok 4/5 ... ok 5/6 ... ok 6/7 ... ok 6/8 ... ok 7/9 ... ok 8/10 ... ok 9/11 ... ok 4/12 ... ok 9/13 ... ok 9/14 ... ok 9/15 ... ok 9/16 ... ok 9/17 ... ok 9/18 ... ok Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Check GitLab API access: OK Redis available via internal API: OK
Access to /var/opt/gitlab/.ssh/authorized_keys: OK gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Sidekiq ...
Running? ... yes Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Reply by email is disabled in config/gitlab.yml Checking LDAP ...
LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab ...
Git configured correctly? ... yes Database config exists? ... yes All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... yes Init script exists? ... skipped (omnibus-gitlab has no init script) Init script up-to-date? ... skipped (omnibus-gitlab has no init script) Projects have namespace: ... 3/3 ... yes 4/5 ... yes 5/6 ... yes 6/7 ... yes 6/8 ... yes 7/9 ... yes 8/10 ... yes 9/11 ... yes 4/12 ... yes 9/13 ... yes 9/14 ... yes 9/15 ... yes 9/16 ... yes 9/17 ... yes 9/18 ... yes Redis version >= 2.8.0? ... yes Ruby version >= 2.3.3 ? ... yes (2.3.5) Git version >= 2.7.3 ? ... yes (2.13.5) Git user has default SSH configuration? ... yes Active users: ... 2
Checking GitLab ... Finished