Skip to content

Update export to not hard fail when one batch export fails

George Koltsov requested to merge georgekoltsov/skip-failing-to-export-batches into master

What does this MR do and why?

Whenever we export a group or a project we usually do that in batches. If one of the batches raises an exception (like db statement timeout) the entire relation fails to export (and export fails as a whole). This MR rescues the exception during batch export, logs it, and continues with the export, so that instead of not exporting the whole relation, we just skip the problematic batch. The logged error should help us with debugging to address the problematic queries in the future.

Mentions #498636 (closed)

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Screenshots or screen recordings

Screenshots are required for UI changes, and strongly recommended for all other merge requests.

Before After

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Edited by George Koltsov

Merge request reports