Incidentsby GlyphIngest performance degredation in Prod EU cluster
Mar 16, 18:55 UTCMar 16, 19:12 UTC
Duration
17m
Impact
Minor
Root cause
Not disclosed
Observe, 90 days
10 incidents
Affected
Not listed by the vendor.
Final update
This incident has been resolved.
Timeline
- Resolved · Mar 16, 19:12 UTC
This incident has been resolved.
- Monitoring · Mar 16, 18:55 UTC
A large increase in tracing data caused ingestion lag on the prod-eu-1 cluster, affecting multiple customers. Encoder replicas were scaled up and subsequently rolled to resolve unassigned partition workers. Memory pressure was identified as a contributing factor. Ingestion lag peaked at up to 45 minutes for some customers and has since recovered to near-normal levels. The team is continuing to monitor.
More from Observe
Full history2026-10-12 Degraded Function For OPAL Copilot in Slow-lane Customer Instanceslasted 8h 45m2026-10-06 Degraded warehouse resume performancelasted 2h 55m2026-10-05 Delayed or missing data from poller-based integrationslasted 1h 3m2026-09-27 Data Transform and Monitor Processing Delays (US-WEST)lasted 1h 46m2026-09-21 Degradation in AI functionalitylasted 23h 31m2026-09-04 Performance degradation in EUlasted 1h 51m