Ingestion and query issues for logs, spans, traces in US

Final update

Data is now processed live and the system are fully operational.

1. Resolved · Jul 1, 10:00 UTC
   Data is now processed live and the system are fully operational.
2. Monitoring · Jul 1, 06:14 UTC
   We continue to monitor the fix. Ingestion is around 45 minutes behind and improving. APIs and dashboards are functioning normally (outside of data waiting to be ingested).
3. Monitoring · Jul 1, 05:22 UTC
   We continue to monitor the situation
4. Monitoring · Jul 1, 04:26 UTC
   We continue to monitor the situation
5. Monitoring · Jul 1, 03:30 UTC
   We are currently burning down the ingestion backlog, and estimate that it will be complete by 2AM PT 2026-07-01.
6. Investigating · Jul 1, 02:25 UTC
   We are attempting additional mitigations to restore ingestion for logs, spans, and traces in the US
7. Investigating · Jul 1, 01:29 UTC
   Our ingestion fix was not successful. We are continuing to investigate possible solutions
8. Investigating · Jul 1, 00:27 UTC
   Our database is stabilized. We are attempting a fix to increase the ingestion rate.
9. Investigating · Jun 30, 23:31 UTC
   We continue to investigate the issue.
10. Investigating · Jun 30, 22:50 UTC
    We continue to investigate the issue
11. Investigating · Jun 30, 21:42 UTC
    We continue to investigate the issue. Ingestion delays are around 40 minutes now.
12. Investigating · Jun 30, 21:16 UTC
    We are currently investigating the issue