Create event-based metric for CI internal pipelines
Problem
At least one Database-based metrics for CI pipelines is timing out (see https://gitlab.com/gitlab-com/sales-team/field-operations/customer-success-operations/-/issues/3127#note_1602227496).
counts_monthly.ci_internal_pipelines
is used as health score for customers to evaluate their usage.
This leads to multiple problems:
- No way for CSM to judge CI usage health for the affected customer
- Likely high database load during Service Ping calculation for the affected customer.
Desired Outcome
A less resource-intensive replacement for the following metrics is in place so that they can be shut off down the line:
counts_monthly.ci_internal_pipelines
counts.ci_internal_pipelines
usage_activity_by_stage_monthly.verify.ci_internal_pipelines
usage_activity_by_stage.verify.ci_internal_pipelines
Proposed solution
Create an event whenever a new entry that would be counted by a CI internal pipeline metric is created and use Internal Event tracking to configure appropriate replacement metrics for the existinc CI build metrics.
Further Information
The explanation in this video outlines why it is important to deliver these new metric. We can only shut off the DB based metrics after the Event-based ones have been established for some time.