SaaS Service Ping Metrics Failures causing null UMAU value

Summary

In multiple recent runs of manual SaaS Service Ping, metrics failures have caused UMAU to be null for our SaaS customer base. This is a significantly important metric for the business and the failure should be treated as a priority1 severity1 issue.

Details

From @cbraza

It looks like the UMAU metric (usage_activity_by_stage_monthly.manage.events) also timed out (or wasn’t correctly recorded) in the pings on 2021-09-16, 2021-09-23, 2021-10-08 , and 2021-10-18 . It was successful on the 2021-10-14 ping

For those pings, I’m seeing -1 for usage_activity_by_stage_monthly.manage.events

Query to view the data

SELECT 
  ping_created_at,
  raw_usage_data_payload,
  raw_usage_data_payload['usage_activity_by_stage_monthly']['manage'] AS usage_by_stage_manage_payload,
  raw_usage_data_payload['usage_activity_by_stage_monthly']['manage']['events'] AS manage_events_umau_metric,
  umau_value
FROM common.fct_usage_ping_payload
WHERE usage_ping_delivery_type = 'SaaS'
  AND ping_created_at BETWEEN '2021-08-01' AND CURRENT_DATE
--  AND dim_usage_ping_id  IN ( --if you want to limit to _just_ the pings used for xMAU reporting
--                             '34561735' --September SaaS ping used in xMAU reporting
--                             , '33892790' --August SaaS ping used in xMAU reporting
--                             )
ORDER BY 1
;