Delayed delivery of Astro Alerts
Oct 20, 06:40 UTCOct 21, 08:49 UTC
Duration
26h 9m
Impact
Major
Root cause
Not disclosed
Astronomer, 90 days
17 incidents
Affected
Not listed by the vendor.
Final update
Astro Alerts delivery has returned to normal, and this incident is resolved. We have applied the fix and fully processed the backlog of delayed alerts. Thank you for your patience while we worked to restore service.
Timeline
- Resolved · Oct 21, 08:49 UTC
Astro Alerts delivery has returned to normal, and this incident is resolved. We have applied the fix and fully processed the backlog of delayed alerts. Thank you for your patience while we worked to restore service.
- Monitoring · Oct 20, 12:38 UTC
The backlog of delayed Astro Alerts has been fully processed, and we are monitoring recovery following the fix. A small number of alerts may still be briefly delayed as the fix completes on remaining systems.
- Identified · Oct 20, 10:42 UTC
The fix has been applied to the majority of affected deployments, and delayed alerts continue to be delivered as we process the backlog. We are addressing a small number of remaining deployments and will provide another update once this is complete.
- Identified · Oct 20, 07:55 UTC
We have identified the cause and are rolling out a fix to the affected deployments. Alerts held during the incident have started to be delivered, and some alerts may continue to be delayed until the rollout is complete. We will provide another update once the fix is fully rolled out.
- Investigating · Oct 20, 06:40 UTC
We are investigating an issue where Astro Alerts notifications may be delayed for some customers. Our team is actively working to resolve the issue, and we will provide an update as soon as we have more information.
More from Astronomer
Full historyPHP Security Advisory: Astro and Astro Private Cloud Not Affected; Review Custom Imagesstill openSecurity Update: Runtime Releases and Guidance for the eMudhra/emSign Certificate Issuelasted 45h 27mOrganization Dashboards are failing to load with Invalid kid parameter errorlasted 1h 23mAstro UI and API are appearing offline for some userslasted 1h 51mCapacity constraints in GCP us-central1 may delay or fail some task executionslasted 7d 21hDag success/failure Astro Alert emails missing deployment & workspace nameslasted 57m