Incidentsby GlyphGrafana Cloud Hosted Logs increased write latency in eu-west-3 region.
Oct 30, 09:30 UTCOct 30, 13:36 UTC
Duration
4h 6m
Impact
Minor
Root cause
Capacity
Grafana Labs, 90 days
66 incidents
Affected
Not listed by the vendor.
Final update
We consider the incident as resolved now. With regards to the cause - a slow physical partition of the backend database, which is used by the control plane of a critical component caused increased latency and occasional overloading with subsequent failing of the write path. Once writes switched to a different partition, the latency dropped and error rate went down.
Timeline
- Resolved · Oct 30, 13:36 UTC
We consider the incident as resolved now. With regards to the cause - a slow physical partition of the backend database, which is used by the control plane of a critical component caused increased latency and occasional overloading with subsequent failing of the write path. Once writes switched to a different partition, the latency dropped and error rate went down.
More from Grafana Labs
Full historySynthetic Monitoring , Jakarta Public Probe Degradationlasted 0mGitHub returning 403 for all Git Sync repositorieslasted 1h 58mOctober usage report visualization issuelasted 3d 3hIncreased query latency for Logs in GCP US Central (prod-us-central-0)lasted 1h 31mElevated Request Errors for Grafana Across Multiple Regionslasted 1h 1mGrafana Cloud: k6 timeoutslasted 0m