Outage 10/27 - 10/29

Final update

Thus far today our recurring issues have cleared. We have taken quite a few steps to triage the issues we'd identified. Though behind the scenes we are still actively monitoring our infrastructure (https://i.imgur.com/C0MYp.gif), things appear to be all clear for now.

1. Resolved · Oct 29, 18:12 UTC
   Thus far today our recurring issues have cleared. We have taken quite a few steps to triage the issues we'd identified. Though behind the scenes we are still actively monitoring our infrastructure (https://i.imgur.com/C0MYp.gif), things appear to be all clear for now.
2. Monitoring · Oct 29, 14:48 UTC
   We have made further improvements overnight, which may have resulted in brief downtime. We will continue to monitor for stability issues today, and provide updates as required.
3. Monitoring · Oct 28, 21:23 UTC
   While we continue to make headway on this issue, we have been able to make a number of improvements that mitigate downtime, although some errors may persist intermittently.
4. Monitoring · Oct 28, 14:38 UTC
   We are continuing to see intermittent degraded performance resulting from issues spanning the last two days.
5. Monitoring · Oct 27, 20:42 UTC
   We have identified some issues which we have triaged. Things appear to be fairly normal again, though we continue to monitor for possible hiccups along the way to recovery. If further issues are discovered, we will take action. https://i.imgur.com/B6rbamU.gifv
6. Monitoring · Oct 27, 20:39 UTC
   A fix has been implemented and we are monitoring closely.
7. Investigating · Oct 27, 18:43 UTC
   We're continuing to work on this issue. In the meantime, users may see degraded performance including 429 errors, being logged out of your account abruptly, inability to comment, trouble viewing your posts or favorites, intermittent overcapacity errors, error messages such as "there was an error. please try again."
8. Investigating · Oct 27, 17:16 UTC
   Our teams continue to work around the clock to resolve this issue. Service stability is intermittent. We will update as information becomes available.
9. Investigating · Oct 27, 14:27 UTC
   We are seeing a spike in 429 errors. This is related to yesterday's outages. We are investigating.