Secrets service outage
Aug 14, 19:30 UTCAug 14, 20:33 UTC
Duration
1h 3m
Impact
Major
Root cause
Not disclosed
Fly.io, 90 days
53 incidents
Affected
Machines API
Final update
This incident has been resolved.
Timeline
- Resolved · Aug 14, 20:33 UTC
This incident has been resolved.
- Monitoring · Aug 14, 20:08 UTC
We have failed over the secrets database to a replica, and the Machines API appears healthy now. We are monitoring for any further issues.
- Identified · Aug 14, 19:30 UTC
We are working to recover our secrets service after a failed deployment. Apps continue to run, but it is not possible to create new apps or update secrets at this time.
More from Fly.io
Full historyIPv6 egress issues on a subset of IAD hostslasted 23mEmergency network maintenance on a subset of hosts in ORDlasted 14mElevated Machine start failures in ARNlasted 1h 1mEmergency maintenance in IADlasted 38mOutbound IPv4 connectivity failures in ARN, JNB, and GRUlasted 2h 10mSlow image pulls delaying Machine starts in IADlasted 1h 28m