Delayed Data Ingestion – Some Datasets May Be Temporarily Stale for US East (N. Virginia)

Final update

This incident has been resolved.

1. Resolved · Jun 3, 19:49 UTC
   This incident has been resolved.
2. Monitoring · Jun 3, 19:32 UTC
   Fix has been applied to address the root cause. We will continue to monitor for a period of time and then mark this incident as resolved.
3. Identified · Jun 3, 19:09 UTC
   The hotfix is currently being deployed. We will provide an update once the deployment is complete and the fix has been validated.
4. Identified · Jun 3, 18:37 UTC
   We've identified a potential fix and completed testing. The hotfix is currently being deployed. We will provide an update once the deployment is complete and the fix has been validated.
5. Identified · Jun 3, 18:02 UTC
   The root cause of the issue has been identified and engineering is working on testing and verifying a fix that addresses the root cause.
6. Investigating · Jun 3, 17:31 UTC
   Ingest lag has been mitigated and data is being ingested at normal rates. Observe's engineering team is continuing to investigate the root cause of the issue. We will post updates here as we make progress.
7. Investigating · Jun 3, 17:03 UTC
   We are continuing to investigate this issue.
8. Investigating · Jun 3, 17:02 UTC
   Data is now being ingested normally without lag. We are continuing to investigate the root cause.
9. Investigating · Jun 3, 16:27 UTC
   We are continuing to investigate this issue.
10. Investigating · Jun 3, 15:27 UTC
    We are currently experiencing ingest delays that may cause some datasets to appear temporarily stale. Our team is actively investigating the issue and working to restore normal data freshness as quickly as possible.