Increased errors on management api leading to project operation failures

Final update

This issue has been resolved and our error rates have returned back to normal. During this incident users would have observed unauthorized/5xx failures across multiple operations on the project operations and dashboard functions. We have since rolled out a fix and all functionality is restored.

1. Resolved · Oct 6, 09:03 UTC
   This issue has been resolved and our error rates have returned back to normal. During this incident users would have observed unauthorized/5xx failures across multiple operations on the project operations and dashboard functions. We have since rolled out a fix and all functionality is restored.
2. Monitoring · Oct 6, 08:13 UTC
   We have identified a rollout causing error increase on management api dependant services, which is causing project operation failures and FGA Authentication errors across multiple functions. We have implementing a fix and observing recovery. Our teams are continuing to monitor for full resolution.
3. Investigating · Oct 6, 07:55 UTC
   We are continuing to investigate this issue.
4. Investigating · Oct 6, 07:53 UTC
   We are investigating an increase in errors on project update flows including creation, pausing/unpausing and upgrading across multiple regions.