Delays in creation of DNS records

Final update

This incident is resolved. DNS creation for new projects has been fixed since 20:35 UTC. Backfill of missing DNS records has been completed at 22:20 UTC. Please contact Support if your project seems impacted by missing DNS records.

1. Resolved · Jul 27, 22:36 UTC
   This incident is resolved. DNS creation for new projects has been fixed since 20:35 UTC. Backfill of missing DNS records has been completed at 22:20 UTC. Please contact Support if your project seems impacted by missing DNS records.
2. Monitoring · Jul 27, 22:23 UTC
   All failed DNS creation has been backfilled, and customers should no longer see missing DNS records in their projects. DNS record creation and latency have returned to normal levels. We will continue to monitor before resolving this incident.
3. Identified · Jul 27, 20:53 UTC
   We have identified and mitigated the issue that was blocking DNS updates. DNS record creation is succeeding, and latency has returned to normal levels. A subset of projects that encountered provisioning failures during the incident will require DNS records to be backfilled, and we are actively remediating these affected projects.
4. Identified · Jul 27, 20:39 UTC
   We have identified the cause of delays in DNS records creation and are actively working on a fix. We will continue to provide updates as things progress.
5. Investigating · Jul 27, 20:34 UTC
   We are investigating failures in provisioning DNS records for projects, there may be delays in creation of DNS records for new or unpaused projects.