Intermittent latency in Eastern US
Sep 29, 16:26 UTCOngoing
Duration
Ongoing
Impact
Minor
Root cause
Not disclosed
Supabase, 90 days
53 incidents
Affected
API Gateway
Final update
Our networking partners have implemented a mitigation to the latency issue at the problematic PoP in the Eastern US, and we have since observed significant improvement in rates of high latency across the region. We are continuing to work with those partners to isolate any additional root causes of latency and improve the reliability of our networking infrastructure across the region.
Timeline
- Identified · Oct 1, 20:23 UTC
Our networking partners have implemented a mitigation to the latency issue at the problematic PoP in the Eastern US, and we have since observed significant improvement in rates of high latency across the region. We are continuing to work with those partners to isolate any additional root causes of latency and improve the reliability of our networking infrastructure across the region.
- Identified · Sep 30, 21:26 UTC
We are seeing signs of improvement and are continuing to work alongside our networking partners towards a resolution. We will provide another update as more information becomes available.
- Identified · Sep 30, 14:54 UTC
We're continuing to coordinate with our networking partners to deliver a permanent resolution. We will provide updates as soon as they're available.
- Identified · Sep 30, 02:14 UTC
We are working with our networking partners on a permanent fix. While we do not have an estimated resolution time, we will share updates here as they become available.
- Identified · Sep 29, 21:35 UTC
A mitigation for this issue was applied earlier today, but we do not have sufficient evidence to conclude that the mitigation resulted in improvement to this eastern US latency issue. We have tied the issue to a particular PoP, and we are continuing to work with our networking partners to bring this issue to a final resolution. We will provide another update within 4 hours, if not before. We appreciate your patience.
- Identified · Sep 29, 17:55 UTC
We are continuing our work to fix this latency issue, which has been observed to impact clients connecting to Supabase Projects from the eastern United States. These clients may include servers and serverless functions located in that geographical region, regardless of the region in which the Project is hosted.
- Identified · Sep 29, 16:26 UTC
We have identified an issue with increased latency for clients in the eastern US during spikes caused by bursty traffic. This is most noticeable during EDT working hours around the :00 and :30 hour marks. We are actively working on a fix. We will provide updates as the fix is implemented.
More from Supabase
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2813:47 UTC4 days ago | Log Ingestion Degradation | minor | 49m |
| Sep 2415:36 UTC8 days ago | Project Lifecycle Issues in eu-west-1 | major | 2h 2m |
| Sep 2410:37 UTC8 days ago | Permission errors in the Supabase Dashboard | critical | 1h 12m |
| Sep 2321:58 UTC9 days ago | Supabase CLI CI workflow failures | minor | 1h 42m |
| Sep 2309:31 UTC9 days ago | Storage search failing for restored projects | minor | 24h 30m |
| Sep 2309:21 UTC9 days ago | Increased error rate in project creation and project restore | major | 1h 28m |