Engine degradation in AWS US-EAST-1 region
Sep 28, 20:06 UTCSep 29, 04:33 UTC
Duration
8h 28m
Impact
Minor
Root cause
Not disclosed
Dremio, 90 days
2 incidents
Affected
Site AvailabilityDremio Cloud - US - Site Availability
Final update
AWS has resolved the issues with service in US-EAST-1. Dremio Cloud Engines (EC2 instances) should be fully operational again across all regions. We will continue to monitor for any additional impact. The latest information from AWS can be found at https://health.aws.amazon.com/health/status.
Timeline
- Resolved · Sep 29, 04:33 UTC
AWS has resolved the issues with service in US-EAST-1. Dremio Cloud Engines (EC2 instances) should be fully operational again across all regions. We will continue to monitor for any additional impact. The latest information from AWS can be found at https://health.aws.amazon.com/health/status.
- Identified · Sep 28, 21:21 UTC
The latest update from AWS indicates they continue working on resolving error rates and increased delays, and that we should see improvement over the next 1-2 hours. Our synthetic testing in US-EAST-1 use1-az2 has begun reporting success. Dremio Cloud engines in the impacted Availability Zone may still experience degradation until fully resolved by AWS.
- Identified · Sep 28, 20:48 UTC
The latest update from AWS (Sep 28 1:43 PM PDT) indicates they are continuing to work on the problem with the single zone in US-EAST-1.
- Identified · Sep 28, 20:11 UTC
The issue has been identified and a fix is being implemented.
- Investigating · Sep 28, 20:06 UTC
Network connectivity for new Dremio Cloud Engines (EC2 instances) in the single availability zone use-az2 in the US-EAST-1 region is degraded. Existing engine instances should not be impacted. The latest information from AWS can be found at https://health.aws.amazon.com/health/status. We will provide updates from AWS as we have them.
More from Dremio
Full historyQuery failures in Dremio Cloud (US & EU)lasted 0mEngine scaling issues in Dremio Cloud (US)lasted 30mDremio Cloud US app and login unavailablelasted 4h 51mQuery failures in Dremio Cloud (US)lasted 0mNetwork Connectivity Errors in Dremio Cloud (US)lasted 0mEmail delivery failures in Dremio Cloud (EU)lasted 3d 21h