State database issues in GRU
Sep 24, 16:31 UTCSep 24, 19:11 UTC
Duration
2h 40m
Impact
Major
Root cause
Not disclosed
Fly.io, 90 days
53 incidents
Affected
GRU - Sao Paulo, BrazilRegional Availability - GRU - Sao Paulo, Brazil
Final update
This incident has been resolved.
Timeline
- Resolved · Sep 24, 19:11 UTC
This incident has been resolved.
- Monitoring · Sep 24, 17:27 UTC
A fix has been implemented and we are monitoring the results.
- Identified · Sep 24, 16:58 UTC
We have identified a bug and are working on a fix.
- Investigating · Sep 24, 16:31 UTC
We are investigating issues in GRU related to a migration of our distributed state database. Apps continue to run, but creating or updating machines in GRU region may fail. Connections to apps in GRU, or connections from clients near GRU region, may fail at this time
More from Fly.io
Full historyIPv6 egress issues on a subset of IAD hostslasted 23mEmergency network maintenance on a subset of hosts in ORDlasted 14mElevated Machine start failures in ARNlasted 1h 1mEmergency maintenance in IADlasted 38mOutbound IPv4 connectivity failures in ARN, JNB, and GRUlasted 2h 10mSlow image pulls delaying Machine starts in IADlasted 1h 28m