Increased Rate of LLM Failure Errors on Agent Platform Calls

Final update

Remediation measures have been fully rolled out, restoring failure rates to baseline. The root cause has been addressed, and the issue is now fully resolved.

1. Resolved · Jan 13, 07:00 UTC
   Remediation measures have been fully rolled out, restoring failure rates to baseline. The root cause has been addressed, and the issue is now fully resolved.
2. Monitoring · Jan 10, 07:51 UTC
   Remediation measures have rolled out and instances of failures have returned to baseline. We are continuing to investigate further measures that may be necessary to completely mitigate the core issue.
3. Identified · Jan 10, 06:17 UTC
   Some Agent Platform conversations utilizing RAG are currently affected by RAG latency increases, in some cases resulting in slower RAG performance or intermittent call failures. Our team is currently working to resolve this.
4. Monitoring · Jan 9, 17:19 UTC
   We have identified the direct cause of the RAG failures, and are monitoring performance. At the moment, instances of call failures have returned to baseline. We are investigating further measures that may be necessary to completely mitigate the core issue.
5. Investigating · Jan 9, 16:36 UTC
   Some Agent Platform conversations utilizing RAG are currently affected by RAG latency increases, in some cases resulting in slower RAG performance or intermittent call failures. Our team is currently working to resolve this.