Performance Degradation in GCP

Final update

The issue with elevated warehouse resume times in GCP has been fully resolved. Elevated p99 queueing times (up to 2 minutes) affecting GCP customers were caused by high warehouse resume times. A case was raised with Snowflake, and warehouse resource management was adjusted to reduce impact. Resume times and query queueing times have returned to normal levels. No further impact is expected.

1. Resolved · Mar 12, 18:26 UTC
   The issue with elevated warehouse resume times in GCP has been fully resolved. Elevated p99 queueing times (up to 2 minutes) affecting GCP customers were caused by high warehouse resume times. A case was raised with Snowflake, and warehouse resource management was adjusted to reduce impact. Resume times and query queueing times have returned to normal levels. No further impact is expected.
2. Monitoring · Mar 12, 17:15 UTC
   The issue with elevated warehouse resume times in GCP has been mitigated. Query queueing times have returned to normal levels and resume times have stabilized. A case was raised with the infrastructure provider and warehouse resource management was adjusted to reduce customer impact during the incident. We are continuing to monitor to confirm the issue is fully resolved.
3. Monitoring · Mar 12, 14:52 UTC
   We are continuing to monitor for any further issues.
4. Monitoring · Mar 12, 14:51 UTC
   Our internal team identified an issue with warehouse resume times in Prod GCP - causing p99 queueing times of up to 2m (including user queries). The issue is believed to be addressed and we are monitoring on our side.