HA Postgres Unavailability
May 7, 02:00 UTCMay 7, 02:54 UTC
Duration
54m
Impact
Major
Root cause
Not disclosed
Render, 90 days
15 incidents
Affected
PostgreSQLWorkflowsOregon - PostgreSQLOregon - WorkflowsFrankfurt - PostgreSQLFrankfurt - WorkflowsOhio - PostgreSQLOhio - WorkflowsSingapore - PostgreSQLSingapore - WorkflowsVirginia - PostgreSQLVirginia - Workflows
Final update
Everything is back to normal, and the incident is now resolved. We are planning long-term mitigations to prevent this issue from recurring, and we will share the results of our investigation with all affected customers.
Timeline
- Resolved · May 7, 02:54 UTC
Everything is back to normal, and the incident is now resolved. We are planning long-term mitigations to prevent this issue from recurring, and we will share the results of our investigation with all affected customers.
- Identified · May 7, 02:47 UTC
All affected instances are back online, though a few databases may still show a stale 'Unready' status. We are working to refresh the status.
- Identified · May 7, 02:38 UTC
We're continuing to see instance recovery across the fleet. Render Workflows is now fully operational.
- Identified · May 7, 02:34 UTC
We're bringing the affected Postgres instances back online and expect full recovery within fifteen minutes.
- Identified · May 7, 02:21 UTC
We've identified the issue and are implementing a fix.
- Investigating · May 7, 02:07 UTC
We are continuing to investigate this issue.
- Investigating · May 7, 02:01 UTC
We are continuing to investigate this issue.
- Investigating · May 7, 02:00 UTC
We're investigating reports of Postgres unavailability in multiple regions. At this point we believe this only impacts databases with HA turned on.
More from Render
Full historyIssues affecting connections to a subset of Postgres Databaseslasted 3h 44mPlatform emails not being sentlasted 30mDegraded network performancelasted 1h 28mDeploying from GitLab may intermittently faillasted 3h 41mDashboard not updating in real time; Some Workflows SDK requests timing outlasted 1h 35mBuilds, deploys, and queued deploys are not starting in all regionslasted 2h 45m