INC20000277

Final update

Current status: We've modified our remediation approach. After further investigation, we've determined that restarting infrastructure in the affected region is the most effective way to restore normal task execution. The infrastructure restart effort is in progress, and we've observed a decrease in task failure rates on infrastructure that has been restarted. We're monitoring to confirm normal task execution is fully restored across all the infrastructure. As a side effect of the restarts, task graph run history from before the incident start time (10:58 UTC October 13, 2026) may currently be unavailable, and history from after that time may be incomplete. We're investigating options to restore this history and we'll provide another update by 22:00 UTC on October 14. Customer experience: Prior to the mitigation: Customers hosted in the affected region may have experienced intermittent issues with scheduled or manual tasks. Most tasks completed as expected, but some may have been marked as failed even though they ran successfully. A small number of tasks may have remained in a pending state or failed to start. Affected users may have seen an error message, such as "Unexpected except

1. Investigating · Oct 14, 03:19 UTC
   Current status: We've modified our remediation approach. After further investigation, we've determined that restarting infrastructure in the affected region is the most effective way to restore normal task execution. The infrastructure restart effort is in progress, and we've observed a decrease in task failure rates on infrastructure that has been restarted. We're monitoring to confirm normal task execution is fully restored across all the infrastructure. As a side effect of the restarts, task graph run history from before the incident start time (10:58 UTC October 13, 2026) may currently be unavailable, and history from after that time may be incomplete. We're investigating options to restore this history and we'll provide another update by 22:00 UTC on October 14. Customer experience: Prior to the mitigation: Customers hosted in the affected region may have experienced intermittent issues with scheduled or manual tasks. Most tasks completed as expected, but some may have been marked as failed even though they ran successfully. A small number of tasks may have remained in a pending state or failed to start. Affected users may have seen an error message, such as "Unexpected exception during task dispatch." After the mitigation: The next time each task runs, it may still be marked as failed with an internal error message even though its query ran successfully. This may happen up to one additional time per task. Customers may also see incomplete task graph run history. Specifi
2. Investigating · Oct 13, 23:54 UTC
   Current status: We're continuing to develop the fix to restore the impacted task metadata. Once it's fully developed and validated, we'll begin deploying it to the affected region. While our remediation efforts are ongoing, before rerunning a task that's reported as failed, we recommend checking query history to confirm whether the task's query completed successfully. We'll provide another update within 4 hours. Customer experience: Customers hosted in the specified region may experience intermittent issues with scheduled or manual tasks. Most tasks complete as expected, but some may be marked as failed even though they ran successfully. A small number of tasks may remain in a pending state or fail to start, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages. ETA: An ETA is not yet available. We'll provide one as soon as possible. Incident start time: 10:58 UTC October 13, 2026 Preliminary root cause: A subset of infrastructure in the region experienced an issue that left the task metadata inconsistent. As a result, some tasks were reported as failed even though they completed successfully, while others remained pending or failed to start.
3. Investigating · Oct 13, 21:47 UTC
   Current status: We're validating our fix to restore the impacted metadata and preparing to begin deployment to the affected region. We'll provide another update within 2 hours. While our remediation efforts are ongoing, before rerunning a task that's reported as failed, we recommend checking query history to confirm whether the task's query completed successfully. Customer experience: Customers hosted in the specified region may experience intermittent issues with scheduled or manual tasks. Most tasks complete as expected, but some may be marked as failed even though they ran successfully. A small number of tasks may remain in a pending state or fail to start, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages. Incident start time: 10:58 UTC October 13, 2026
4. Investigating · Oct 13, 20:06 UTC
   Current status: We're continuing our development of the fix to restore the impacted metadata. We'll provide another update within 2 hours. While our remediation efforts are ongoing, before rerunning a task that's reported as failed, we recommend checking query history to confirm whether the task's query completed successfully. Customer experience: Customers hosted in the specified region may experience intermittent issues with scheduled or manual tasks. Most tasks complete as expected, but some may be marked as failed even though they ran successfully. A small number of tasks may remain in a pending state or fail to start, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages. Incident start time: 10:58 UTC October 13, 2026
5. Investigating · Oct 13, 18:36 UTC
   Current status: Our investigation indicates that the directory issue is limited to the records the metadata store keeps for task execution. We're developing a fix to restore the impacted metadata and resolve the impact; however, due to the complexity of the issue, we expect this will take an extended amount of time. Once complete, we'll proceed with deploying the fix as a potential mitigation. We'll provide another update within 2 hours. Customer experience: Customers hosted in the specified region may experience intermittent issues with scheduled or manual tasks. Most tasks complete as expected, but some may be marked as failed even though they ran successfully. A small number of tasks may remain in a pending state or fail to start, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages. Incident start time: 10:58 UTC October 13, 2026
6. Investigating · Oct 13, 17:38 UTC
   Current status: We've determined that a directory issue within the components of the metadata store responsible for facilitating the impacted tasks is preventing some task records from being read consistently, which is causing the task failures. We're working to identify the origin of the directory issue to assist us in restoring normal task execution. We'll provide another update within 1 hour. Customer experience: Customers hosted in the specified region may experience intermittent issues with scheduled or manual tasks. Most tasks complete as expected, but some may be marked as failed even though they ran successfully. A small number of tasks may remain in a pending state or fail to start, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages. Incident start time: 10:58 UTC October 13, 2026
7. Investigating · Oct 13, 16:40 UTC
   Current status: Our investigation has identified that tasks appear to be failing due to an a potential issue with a backend record lookup on the metadata database layer, and we're working to determine what's causing these records to return null and result in task failures. We'll provide another update within 1 hour. Customer experience: Customers hosted in the specified region may experience failures when executing scheduled or manual tasks. Tasks may be marked as failed even though the underlying query completed successfully, or may fail to initiate. Affected users may see an "Unexpected exception during task completion" message or similar error messages. Incident start time: 10:58 UTC October 13, 2026
8. Investigating · Oct 13, 15:53 UTC
   Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 1 hour. Customer experience: Customers hosted in the specified regions may be unable to execute scheduled or manual tasks. Tasks may be stuck in a pending state or fail to initiate, and affected users may see an "Unexpected exception during task dispatch" message or similar error messages.