Incidentsby GlyphDegraded performance for Grafana Cloud Metrics in prod-us-central-7
Nov 11, 20:37 UTCNov 11, 22:13 UTC
Duration
1h 36m
Impact
Major
Root cause
Not disclosed
Grafana Labs, 90 days
69 incidents
Affected
Azure US Central - us-central7Azure US Central - us-central7: IngestionAzure US Central - prod-us-central-7: QueryingAzure US Central - prod-us-central-7: IngestionMetrics - Azure US Central - prod-us-central-7: QueryingMetrics - Azure US Central - prod-us-central-7: IngestionLogs - Azure US Central - us-central7Traces - Azure US Central - us-central7: Ingestion
Final update
Increased latency on a cloud provider database resulted in a 50m write and rule evaluation outage, starting about 2020 UTC. Metrics rule evaluations were last to recover, around 2110 UTC.
Timeline
- Resolved · Nov 11, 22:13 UTC
Increased latency on a cloud provider database resulted in a 50m write and rule evaluation outage, starting about 2020 UTC. Metrics rule evaluations were last to recover, around 2110 UTC.
- Monitoring · Nov 11, 22:07 UTC
Traffic has recovered and we are monitoring the results.
- Investigating · Nov 11, 21:27 UTC
We are continuing to investigate this issue.
- Investigating · Nov 11, 21:24 UTC
We are continuing to investigate this issue.
- Investigating · Nov 11, 20:37 UTC
We are investigating an issue affecting Grafana Cloud Metrics, Logs, and Traces in the prod-us-central-7 region. Some customers may see failed or delayed writes, query errors, and failed alerting and recording rule evaluations.
More from Grafana Labs
Full historyElevated query errors for Grafana Cloud Metrics in prod-us-east-3lasted 4h 14mCloud Logs writes - Elevated latency and error rates in prod-eu-central-0lasted 17mMimir query unexpected response with status code 500lasted 8h 32mSynthetic Monitoring , Jakarta Public Probe Degradationlasted 0mGitHub returning 403 for all Git Sync repositorieslasted 1h 58mOctober usage report visualization issuelasted 3d 3h