Add setting to include retried jobs for pipeline webhooks
For the Datadog CI integration we are using pipeline webhooks and there was a breaking change in !53159 (merged) that is filtering out retried jobs. We needed those to show visibility on them.
Retried jobs were excluded from the payload for performance reasons, but we can add a setting on webhooks to include retried jobs in the payload. For the first iteration the setting does not need a UI change because it will just be used for the Datadog integration.
The setting can be added as a new boolean column on the web_hooks table and maybe we can have a separate data builder for a pipeline including retry jobs.
cc @Andysoiron
Edited by Andy Schoenen