Direct Transfer - Missing content-length header
Problem
In our logs, we've seen a Missing content-length header
for one single user:
Full stacktrace:
[app/services/bulk_imports/file_download_service.rb:88:in `raise_error', lib/bulk_imports/file_downloads/validations.rb:47:in `validate_size!', lib/bulk_imports/file_downloads/validations.rb:42:in `validate_content_length', app/services/bulk_imports/file_download_service.rb:63:in `block (2 levels) in download_file', lib/gitlab/legacy_http.rb:32:in `perform_request', lib/gitlab/http.rb:48:in `public_send', lib/gitlab/http.rb:48:in `block (2 levels) in singleton class', lib/bulk_imports/clients/http.rb:125:in `public_send', lib/bulk_imports/clients/http.rb:125:in `block in request', lib/bulk_imports/clients/http.rb:162:in `with_error_handling', lib/bulk_imports/clients/http.rb:124:in `request', lib/bulk_imports/clients/http.rb:36:in `stream', app/services/bulk_imports/file_download_service.rb:56:in `block in download_file', app/services/bulk_imports/file_download_service.rb:53:in `open', app/services/bulk_imports/file_download_service.rb:53:in `download_file', app/services/bulk_imports/file_download_service.rb:41:in `execute', lib/bulk_imports/projects/pipelines/repository_bundle_pipeline.rb:15:in `extract', lib/bulk_imports/pipeline/runner.rb:77:in `block in extracted_data_from', lib/bulk_imports/pipeline/runner.rb:57:in `run_pipeline_step', lib/bulk_imports/pipeline/runner.rb:76:in `extracted_data_from', lib/bulk_imports/pipeline/runner.rb:15:in `run', app/workers/bulk_imports/pipeline_worker.rb:65:in `run', app/workers/bulk_imports/pipeline_worker.rb:30:in `block in perform', app/services/concerns/exclusive_lease_guard.rb:29:in `try_obtain_lease', app/workers/bulk_imports/pipeline_worker.rb:26:in `perform', lib/gitlab/sidekiq_middleware/skip_jobs.rb:49:in `call', lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:29:in `call', lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform', lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform', lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call', lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform', lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform', lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call', lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context', lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call', lib/gitlab/application_context.rb:124:in `block in use', lib/gitlab/application_context.rb:124:in `use', lib/gitlab/application_context.rb:62:in `with_context', lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call', lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call', lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call', lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call', lib/gitlab/database/query_analyzer.rb:37:in `within', lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call', lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call', lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call', lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call', lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call', lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call', lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call', lib/gitlab/sidekiq_middleware/server_metrics.rb:94:in `block in call', lib/gitlab/sidekiq_middleware/server_metrics.rb:122:in `block in instrument', lib/gitlab/metrics/background_transaction.rb:33:in `run', lib/gitlab/sidekiq_middleware/server_metrics.rb:122:in `instrument', lib/gitlab/sidekiq_middleware/server_metrics.rb:93:in `call', lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call', lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job', lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call', lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call', lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call']
This has also been reported in a help request issue from Support and the customer started another import on Oct 30th.
Proposal
tbd
Edited by Magdalena Frankiewicz