Alerts on the metrics dashboard should indicate whether the alert is firing
Problem to solve
When a user goes to the metrics dashboard, they can see whether an alert is configured for a particular metric. However, based on the numerical value of the configured thresh-hold and set-up of the chart, it can be difficult to tell whether the alert is firing. This can be disorienting and waste time during a fire fight when a responder is trying to determine root cause of an alert they received but their metrics charts do not immediately indicate that something has gone wrong.
Example:
This alert is firing, but it's hard to see the threshold line on the chart or determine if the alert is firing.
Intended users
Proposal
The simplest change here would be to turn the existing badges red if the alert is firing. We should also add text to let the users know the alert is firing so color isn't the only indicator that something is going wrong. That could look like this:
| Single alert | Multiple alerts |
|---|---|
 |
 |
With the multiple alerts example: if multiple alerts are firing, we'll likely have to truncate the text with a ... and display the full text in the tooltip. So, in this scenario, it's likely only the first alert that's firing will be visible on the screen.