Upstream network issues
Sep 2, 14:18 UTCSep 2, 15:57 UTC
Duration
1h 39m
Impact
Minor
Root cause
Network
Fly.io, 90 days
52 incidents
Affected
LAX - Los Angeles, California (US)SJC - San Jose, California (US)Regional Availability - LAX - Los Angeles, California (US)Regional Availability - SJC - San Jose, California (US)
Final update
This incident has been resolved.
Timeline
- Resolved · Sep 2, 15:57 UTC
This incident has been resolved.
- Monitoring · Sep 2, 15:33 UTC
A fix has been implemented and we are monitoring the results.
- Identified · Sep 2, 14:56 UTC
We're updating the affected region list to also include SJC since this seems to be a wider upstream issue in US West Coast.
- Identified · Sep 2, 14:48 UTC
We have put in some temporary mitigations along with our providers. However since the root cause of this issue lies within a bigger upstream transit provider, you may continue to see some elevated latency and connection issues in/around affected regions. We're still working closely with them to resolve the root cause.
- Identified · Sep 2, 14:18 UTC
We have observed an upstream network issue in LAX. Connections to some destinations may see elevated latency and packet loss. We're working with our upstream to resolve this issue.
More from Fly.io
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2416:31 UTC | State database issues in GRU | major | 2h 40m |
| Sep 2414:51 UTC | Private Networking issues (6PN) | major | 46m |
| Sep 2318:44 UTC | Partial Sprites outage | major | 7h 28m |
| Sep 2314:47 UTC | Elevated private networking errors | major | 36m |
| Sep 2312:42 UTC | Upstash unavailability in FRA region | major | 1h 22m |
| Sep 2306:18 UTC | IPv6 Networking Issues in DFW | major | 5h 57m |
Also caused by network
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1901:36 UTC |  Cloudflare | Elevated errors in Ashburn, VA (IAD)Cloudflare | none | 0m |
| Sep 1411:59 UTC |  CircleCI | Increased wait times for macOS jobsCircleCI | minor | 1h |
| Sep 410:57 UTC |  Netlify | Increased errors on High Performance Edge Network - FRA RegionNetlify | minor | 0m |
| Sep 116:11 UTC |  ClickHouse | Service degradation in GCP us-central-1ClickHouse | none | 19m |
| Sep 114:44 UTC |  Google Cloud | Multiple products in us-central1-b are experiencing network service degradation.Google Cloud | major | 4h 8m |
| Aug 1503:42 UTC |  AWS | Increased Packet lossAWS | minor | 3d |
Sources: vendors' own status pages, published postmortems and SEC 8-K Item 1.05 filings, read daily. Times as reported. Logos via logo.dev; trademarks belong to their owners.