Intermittent 500 Errors on Serverless/GenAI Inference API

Final update

The connectivity issues affecting our Serverless/GenAI Inference API have been fully resolved. Our engineering teams successfully completed the connectivity restoration. All systems should be functioning normally, and the endpoint should be fully operational.

1. Resolved · Jun 17, 00:29 UTC
   The connectivity issues affecting our Serverless/GenAI Inference API have been fully resolved. Our engineering teams successfully completed the connectivity restoration. All systems should be functioning normally, and the endpoint should be fully operational.
2. Monitoring · Jun 16, 23:29 UTC
   Our engineering teams have successfully begun implementing mitigation steps to resolve the connectivity issues affecting the inference API. We will provide another update once the API has fully recovered and error rates return to normal.
3. Investigating · Jun 16, 22:00 UTC
   We are actively investigating an issue causing elevated HTTP 500 error rates for customers utilizing our Serverless/GenAI Inference API. Customer Impact: Customers making calls to the inference API, specifically targeting /v1/* endpoints, will experience intermittent HTTP 500 errors and failed requests.