Incidentsby GlyphQStash: Degraded performance
Apr 18, 12:36 UTCApr 18, 13:18 UTC
Duration
42m
Impact
Minor
Root cause
Not disclosed
Upstash, 90 days
4 incidents
Affected
EU-CENTRAL-1QStash
Final update
An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.
Timeline
- Postmortem · Apr 18, 13:19 UTC
An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.
- Resolved · Apr 18, 13:18 UTC
This incident has been resolved.
- Monitoring · Apr 18, 12:46 UTC
A fix has been implemented and we are monitoring the results.
- Investigating · Apr 18, 12:36 UTC
We are continuing to investigate this issue.
- Investigating · Apr 18, 12:36 UTC
We are currently investigating this issue.
More from Upstash
Full historyBrief connection proxy degradation in us-east-1lasted 0mIntermittent DNS Resolution Errors for Upstash Vector in US East (us-east-1)lasted 0mUpstash Console login issuelasted 0mMessage Persistence Issue , QStash us-east-1lasted 0mFly.io infrastructure disruption affecting some Upstash Redis databases on Fly.io DFW Regionlasted 1h 15mQStash us-east-1 - URL Publish Errorslasted 0m