Investigating intermittent timeouts on historical APIs
Apr 27, 10:13 UTCApr 28, 22:26 UTC
Duration
36h 13m
Impact
Critical
Root cause
Storage
Databento, 90 days
15 incidents
Affected
Historical
Final update
This incident has been resolved.
Timeline
- Resolved · Apr 28, 22:26 UTC
This incident has been resolved.
- Monitoring · Apr 28, 00:34 UTC
We have taken additional steps to resolve the slow operations on the storage cluster. We will continue to monitor for issues.
- Identified · Apr 27, 14:39 UTC
We are still experiencing performance issues on our storage cluster. This is causing intermittent issues on the historical API and delays to historical data availability. We are working on a fix.
- Monitoring · Apr 27, 12:56 UTC
We have taken steps to resolve the slow operations on the storage cluster. We will continue to monitor for issues.
- Identified · Apr 27, 10:38 UTC
We have taken action to mitigate the impact. Our systems engineers have identified the root cause and are working to resolve the issue. Customers may continue to experience timeouts and errors from the historical API.
- Investigating · Apr 27, 10:14 UTC
We are continuing to investigate this issue.
- Investigating · Apr 27, 10:13 UTC
We are currently investigating intermittent issues on our historical API. We believe this is due to slow reads on our storage cluster.