Secrets service outage
Aug 14, 19:30 UTCAug 14, 20:33 UTC
Duration
1h 3m
Impact
Major
Root cause
Not disclosed
Fly.io, 90 days
52 incidents
Affected
Machines API
Final update
This incident has been resolved.
Timeline
- Resolved · Aug 14, 20:33 UTC
This incident has been resolved.
- Monitoring · Aug 14, 20:08 UTC
We have failed over the secrets database to a replica, and the Machines API appears healthy now. We are monitoring for any further issues.
- Identified · Aug 14, 19:30 UTC
We are working to recover our secrets service after a failed deployment. Apps continue to run, but it is not possible to create new apps or update secrets at this time.
More from Fly.io
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2416:31 UTC | State database issues in GRU | major | 2h 40m |
| Sep 2414:51 UTC | Private Networking issues (6PN) | major | 46m |
| Sep 2318:44 UTC | Partial Sprites outage | major | 7h 28m |
| Sep 2314:47 UTC | Elevated private networking errors | major | 36m |
| Sep 2312:42 UTC | Upstash unavailability in FRA region | major | 1h 22m |
| Sep 2306:18 UTC | IPv6 Networking Issues in DFW | major | 5h 57m |
Sources: vendors' own status pages, published postmortems and SEC 8-K Item 1.05 filings, read daily. Times as reported. Logos via logo.dev; trademarks belong to their owners.