High number of 5XX on the Machines API and dashboard

Final update

This incident has been resolved.

1. Resolved · Jul 20, 17:09 UTC
   This incident has been resolved.
2. Monitoring · Jul 20, 13:34 UTC
   We are still working on fixing degraded Managed Postgres clusters.
3. Monitoring · Jul 20, 09:14 UTC
   Some Managed Postgres v1 clusters are degraded. We are working on fixing them. Managed Postgres v2 is unaffected.
4. Monitoring · Jul 20, 08:02 UTC
   A fix has been implemented and we are monitoring the results.
5. Identified · Jul 20, 07:52 UTC
   We've identified an internal service providing authentication to our Machines API has failed, our team is currently looking at our options for restoring this service. Existing Machines/Apps will continue to run as normal. Thank you for your patience.
6. Identified · Jul 20, 07:51 UTC
   We've identified an internal service providing authentication to our Machines API has failed, our team is currently looking at our options for restoring this service. Existing Machines/Apps will continue to run as normal. Thank you for your patience.
7. Investigating · Jul 20, 07:48 UTC
   We are continuing to investigate this issue.
8. Investigating · Jul 20, 07:10 UTC
   Existing machines are unaffected. We are investigating the issue.