Serverless Inference - Intermittent Rate Limiting Affecting Some Customers Using Anthropic Models

Final update

The issue is resolved, and service is operating normally.

1. Resolved · Apr 27, 11:37 UTC
   The issue is resolved, and service is operating normally.
2. Monitoring · Apr 27, 11:07 UTC
   We identified the cause of intermittent HTTP 429 responses affecting some customers using Anthropic models on DigitalOcean Serverless Inference and applied a mitigation. Service has recovered, and we are monitoring stability.
3. Investigating · Apr 27, 10:38 UTC
   We are investigating an issue affecting some customers using DigitalOcean Serverless Inference with Anthropic models. Over the last two hours, impacted customers may have experienced intermittent request failures, including HTTP 429 responses, on some Anthropic model requests. Our engineering team is actively investigating the issue. We apologize for the inconvenience and will share another update as soon as more information is available.