Skip to content

BulkImport - Batches in Created State should be processed when retried

Max Fan requested to merge 427480_retry_bulk_import_if_all_batches_fail into master

What does this MR do and why?

Currently, when all batches fail and are retried, they are automatically skipped because import_in_progress? only checks for started batches but when batches are retried, they're put into a :created state

Screenshots or screen recordings

n/a

Before After

How to set up and validate locally

It's a bit complicated, details are in: #427480 (closed)

If the workers are re-tried, you should see duplicates of pipelineSchedules being created, at least until FF bulk_import_idempotent_workers is enabled.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Merge request reports