Databento portal and historical API down
Aug 6, 15:05 UTCAug 6, 19:32 UTC
Duration
4h 26m
Impact
Critical
Root cause
Storage
Databento, 90 days
13 incidents
Affected
PortalHistorical
Final update
This incident has been resolved.
Timeline
- Resolved · Aug 6, 19:32 UTC
This incident has been resolved.
- Monitoring · Aug 6, 15:05 UTC
We identified an issue with one of the storage metadata servers affecting IO operations on our storage cluster. This resulted in a cascade of effects causing our web services to hang. We have failed over the problem server and all historical API and web services are back operational. Batch job processing was delayed during the incident, but jobs are now progressing. We are continuing to monitor for any issues.
- Identified · Aug 6, 12:53 UTC
We are continuing to work on a fix for this issue.
- Identified · Aug 6, 11:33 UTC
The issue has been identified and a fix is being implemented.
- Investigating · Aug 6, 11:13 UTC
We are investigating an issue with the historical API and Databento web portal
More from Databento
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 415:12 UTC4 weeks ago | OPRA historical data for 2026-09-04 delayed | none | 2d 23h |
| Aug 2807:59 UTC5 weeks ago | Live authentication timeouts in NY4 | critical | 6h 50m |
| Aug 2109:56 UTC6 weeks ago | Batch jobs being queued indefinitely | major | 3h 34m |
| Aug 1319:04 UTC7 weeks ago | GLBX.MDP3 intraday data is delayed | none | 5h 5m |
| Aug 1022:55 UTC7 weeks ago | GLBX.MDP3 delays in the Historical API | minor | 4h 3m |
| Aug 407:47 UTC2 months ago | Consistent 504 timeout on the Historical API | major | 16h 13m |
Also caused by storage
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 2022:13 UTC2 weeks ago | Incident with Pull Requests | minor | 1h 9m | |
| Sep 1715:50 UTC2 weeks ago | AutoOps node metrics temporarily unavailable in some regions | major | 41m | |
| Sep 1015:26 UTC3 weeks ago | Unresponsive Projects | major | 27h 40m | |
| Aug 2623:37 UTC5 weeks ago | Disruption with GitHub Billing | minor | 20h 7m | |
| Aug 2413:56 UTC5 weeks ago | Actions delays in starting runs | minor | 38m | |
| Aug 1316:21 UTC7 weeks ago | Disruption with GHEC Team Sync | minor | 2h 6m |