Move direct transfer and import/export hardcoded limits to settings
Release notes
Migration by direct transfer has some hardcoded limits that can be moved to application settings to allow self-managed GitLab users to tune them according to their needs. Customers are especially interested in possibility to change 5GB of maximum relation size limit. Limits can then also be adjusted on GitLab.com.
Summary
Import/Export and GitLab Migration have some hardcoded validations that could be moved to application settings to allow Self Managed instances to tune them according to their needs.
Hardcoded validations
| Validation | Harcoded value | Description | Documentation | Used by |
|---|---|---|---|---|
| BulkImports::FileDownloadService | 5GB | Maximum relation size | Direct Transfer | |
|
|
10GB | Maximum size of a decompressed archive | Docs Link, Issue for moving to application settings | Direct Transfer and Import/Export |
|
|
210 seconds | Maximum number of seconds to wait for decompressing an archive file | Direct Transfer and Import/Export | |
| Import::GitlabProjects::RemoteFileValidator | 10GB | Maximum size of an import file that will be download from remote location | Link (Small note at the end of the section) | Import/Export (Project only) |
| Gitlab::ImportExport::Json::NdjsonReader Note: Gets implemented in Move Maximum length an NDJSON row can have limi... (#421433 - closed) | 50MB | Maximum length an NDJSON row can have | Direct Transfer and Import/Export | |
|
|
90mins | This constant is planned to be removed. issue | ||
|
|
5mins | Direct Transfer |
BulkImports::FileDownloadService and Import::GitlabProjects::RemoteFileValidator should be combined in just one settings as they are related to the maximum file size the Importers will attempt to download.
Proposed solution
- Create the new application settings and use the current hardcoded values as default
- Update documentation
This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.