Delays in Drains, Observability, and Workflow in Washington (iad1)
Oct 10, 00:15 UTCOct 10, 01:37 UTC
Duration
1h 21m
Impact
Major
Root cause
Not disclosed
Vercel, 90 days
30 incidents
Affected
DrainsLogsObservabilityQueuesWorkflowObservability - DrainsObservability - LogsObservability - Observability
Final update
All services have recovered.
Timeline
- Resolved · Oct 10, 01:37 UTC
All services have recovered.
- Monitoring · Oct 10, 01:12 UTC
Delayed Drains deliveries, Observability data, and Build logs have been processed now. We are continuing to monitor and we will provide additional updates as they become available.
- Identified · Oct 10, 00:35 UTC
A fix has been implemented and delivery has resumed. Delayed Drains deliveries and Observability data are being processed. We are continuing to monitor.
- Investigating · Oct 10, 00:15 UTC
We've identified an issue where some customers may experience delayed drain delivery, delayed logs, metrics, and traces, and Workflow runs that remain pending in Washington (iad1). We are investigating this issue. We will provide additional updates as they become available.
More from Vercel
Full historyVercel Auth login failures for pages with Deployment Protection enabledlasted 16mElevated Sandbox error rates in Paris (cdg1)lasted 25mBuild failures and 500 errors for functions using Edge runtimelasted 27mDeployment stuck in initializing statelasted 55mElevated Errors Triggering Deploymentslasted 50mElevated Vercel KMS and Connect Errorslasted 0m