Skip to content

Handle max import size

Grant Young requested to merge gy-handle-max-import-size into master

Closes #348 (closed)

Update GPT Data Generator to handles the Max Import Size limit setting in the same way as soft delete. Will diable when importing and set back to what it was beforehand.

MR also does some streamlining for GPT Data Generator lib functions.

Will be released as 1.0.11

New Import
GPT Data Generator v1.0.11 - opinionated test data for the GitLab Performance Tool
Checking that GitLab environment 'http://gitlab' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: http://gitlab, Version: 13.5.0-pre fe53f9c3582

| Vertical data: importing large projects for GPT...
Creating group gpt
Creating group gpt/large_projects
Checking if project gitlabhq1 already exists in gpt/large_projects/gitlabhq1...
Disabling Max Import Size limit on environment...
Updating application settings: {:max_import_size=>0}
Tarball is remote, downloading...
Starting import of Project 'gitlabhq1' from tarball 'https://gitlab.com/gitlab-org/quality/performance-data/-/raw/master/projects_export/small-project_13.0.0.tar.gz' under namespace 'gpt/large_projects' to GitLab environment 'http://gitlab'

Checking that GitLab environment 'http://gitlab' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: http://gitlab, Version: 13.5.0-pre fe53f9c3582
Importing project gitlabhq1...
Note that this may take some time to upload a file to the target environment.

Project tarball has successfully uploaded and started to be imported with ID '2'
Waiting until Project '2' has imported successfully....
Project has successfully imported in 6 seconds:
http://gitlab/gpt/large_projects/gitlabhq1

| Vertical data: successfully generated after 9 seconds!
█ GPT data generation finished after 9 seconds.
Project already exists but is out of date
GPT Data Generator v1.0.11 - opinionated test data for the GitLab Performance Tool
Checking that GitLab environment 'http://gitlab' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: http://gitlab, Version: 13.5.0-pre fe53f9c3582

| Vertical data: importing large projects for GPT...
Group gpt already exists
Group gpt/large_projects already exists
Checking if project gitlabhq1 already exists in gpt/large_projects/gitlabhq1...
Project gpt/large_projects/gitlabhq1 already exists
existing_project_version is Version: 1
Large project gpt/large_projects/gitlabhq1 already exists on environment but is a different version (1.01) than configured (1).
The Generator will replace this project.
Do you want to proceed? [Y/N]
y
Delete existing project {"id"=>2, "name"=>"gitlabhq1", "path_with_namespace"=>"gpt/large_projects/gitlabhq1", "description"=>"Generated and maintained by GPT Data Generator v1.0.11. Please do not edit this project's description or data loss may occur.\n\nVersion: 1"}
Waiting for project gpt/large_projects/gitlabhq1 to be deleted...
Delete successful
Disabling Max Import Size limit on environment...
Updating application settings: {:max_import_size=>0}
Tarball is remote, downloading...
Starting import of Project 'gitlabhq1' from tarball 'https://gitlab.com/gitlab-org/quality/performance-data/-/raw/master/projects_export/small-project_13.0.0.tar.gz' under namespace 'gpt/large_projects' to GitLab environment 'http://gitlab'

Checking that GitLab environment 'http://gitlab' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: http://gitlab, Version: 13.5.0-pre fe53f9c3582
Importing project gitlabhq1...
Note that this may take some time to upload a file to the target environment.

Project tarball has successfully uploaded and started to be imported with ID '3'
Waiting until Project '3' has imported successfully....
Project already exists and is up to date
GPT Data Generator v1.0.11 - opinionated test data for the GitLab Performance Tool
Checking that GitLab environment 'http://gitlab' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: http://gitlab, Version: 13.5.0-pre fe53f9c3582

| Vertical data: importing large projects for GPT...
Group gpt already exists
Group gpt/large_projects already exists
Checking if project gitlabhq1 already exists in gpt/large_projects/gitlabhq1...
Project gpt/large_projects/gitlabhq1 already exists
Project version number matches version from the Project Config File.
Existing large project gpt/large_projects/gitlabhq1 is valid. Skipping project import...

| Vertical data: successfully generated after 2 seconds!
█ GPT data generation finished after 2 seconds.
Edited by Grant Young

Merge request reports

Loading