Increased Job Queue Times: Windows, Android, and GPU
Aug 4, 19:27 UTCAug 4, 23:40 UTC
Duration
4h 13m
Impact
Minor
Root cause
Dependency
CircleCI, 90 days
24 incidents
Affected
Machine JobsWindows Jobs
Final update
Queue times for Android and Windows jobs have reduced significantly over the last hour. You may still notice brief, isolated queuing at times, but this is no longer at incident-level impact. This was related to capacity constraints with a third-party infrastructure provider. We thank you for your patience while we monitored the situation. If you have any issues, please reach out to our Support team.
Timeline
- Resolved · Aug 4, 23:40 UTC
Queue times for Android and Windows jobs have reduced significantly over the last hour. You may still notice brief, isolated queuing at times, but this is no longer at incident-level impact. This was related to capacity constraints with a third-party infrastructure provider. We thank you for your patience while we monitored the situation. If you have any issues, please reach out to our Support team.
- Monitoring · Aug 4, 22:20 UTC
Queue times for both Android and Windows jobs, affected by capacity constraints with our third-party infrastructure provider, have been recovering significantly for the last half hour. We're continuing to monitor for a bit longer to confirm they return to normal levels. We appreciate your patience.
- Monitoring · Aug 4, 21:46 UTC
Queue times for both Android and Windows jobs continue to be volatile, with sharp swings up and down. This remains related to capacity constraints with our third-party infrastructure provider. Our team will continue to monitor and provide updates at least every 30 minutes. We appreciate your patience.
- Monitoring · Aug 4, 21:16 UTC
Queue times for both Android and Windows jobs, which had been recovering, have started to rise again. This continues to be related to capacity constraints with our third-party infrastructure provider. We'll continue to monitor and provide updates at least every 30 minutes. We appreciate your patience.
- Monitoring · Aug 4, 20:33 UTC
Queue times continue to gradually recover with our third-party infrastructure provider, though we've seen a slight uptick in the last 30 mins. We're keeping an eye on this and will keep you updated as things get back to normal. Again, thank you for your patience.
- Monitoring · Aug 4, 19:59 UTC
We're starting to see queue times slowly recovering. We'll be monitoring this situation, we appreciate your patience.
- Investigating · Aug 4, 19:27 UTC
We are experiencing increased queue times for Windows, Android, and GPU jobs due to capacity constraints with a third-party infrastructure provider. Jobs will continue to be processed but may take longer than usual to start. Thank you for your patience while our engineers work to resolve this.
More from CircleCI
Full historyIncreased wait time for Machine and Remote Docker jobsFrom 13:55 to 15:07 UTC on November 3, customers running Linux machine jobs and Remote Docker saw increased wait times for their jobs to start, and the delays were longest from 14:16 to 14:41.lasted 54mPostmortemDelays for gen2 dedicated IP range jobslasted 1h 3mIncreased Docker gen2 wait timeslasted 1h 24mIncreased wait times for macOS jobs on m4pro.largelasted 2h 16mDelays starting macOS jobs that use Xcode 26.6.0lasted 1h 13mDelay in data appearing in UI and APIlasted 14h 36m