Incidentsby GlyphHosted Traces elevated write latency in prod-us-central-0 region.
Jan 21, 13:24 UTCJan 21, 15:21 UTC
Duration
1h 57m
Impact
Minor
Root cause
Not disclosed
Grafana Labs, 90 days
66 incidents
Affected
Not listed by the vendor.
Final update
We consider this incident as resolved since the latency hasn't been elevated since the fix was applied. The issue was caused by a latency spike in a downstream dependency, causing an increased backpressure on the Hosted Traces ingestion path, which degraded gateway performance and resulted in an elevated write latency. After clearing the affected gateway services the degraded state went away and normal operation was restored.
Timeline
- Resolved · Jan 21, 15:21 UTC
We consider this incident as resolved since the latency hasn't been elevated since the fix was applied. The issue was caused by a latency spike in a downstream dependency, causing an increased backpressure on the Hosted Traces ingestion path, which degraded gateway performance and resulted in an elevated write latency. After clearing the affected gateway services the degraded state went away and normal operation was restored.
More from Grafana Labs
Full historySynthetic Monitoring , Jakarta Public Probe Degradationlasted 0mGitHub returning 403 for all Git Sync repositorieslasted 1h 58mOctober usage report visualization issuelasted 3d 3hIncreased query latency for Logs in GCP US Central (prod-us-central-0)lasted 1h 31mElevated Request Errors for Grafana Across Multiple Regionslasted 1h 1mGrafana Cloud: k6 timeoutslasted 0m