Email notifications for SLOs, Triggers, and Anomaly Detection not sending
Oct 22, 16:06 UTCOct 22, 17:07 UTC
Duration
1h 1m
Impact
Major
Root cause
Not disclosed
Honeycomb, 90 days
4 incidents
Affected
ui.honeycomb.io - US1 Trigger & SLO Alertingui.eu1.honeycomb.io - EU1 Trigger & SLO Alerting
Final update
Between 03:53 PM UTC to 4:08 PM UTC we saw email send failures elevate in which a small number of customers (10 enterprise, 8 self-serve, and 1 pro plan) were impacted. This came to 508 emails in total, or ~1% of our daily email send. We are working to ensure this failure mode is not able to happen again.
Timeline
- Resolved · Oct 22, 17:07 UTC
Between 03:53 PM UTC to 4:08 PM UTC we saw email send failures elevate in which a small number of customers (10 enterprise, 8 self-serve, and 1 pro plan) were impacted. This came to 508 emails in total, or ~1% of our daily email send. We are working to ensure this failure mode is not able to happen again.
- Identified · Oct 22, 16:06 UTC
We have identified an issue where emails for SLOs, Triggers, and Anomaly Detection are not sending. We are working to fix.