Transform North America: Job Execution Service Interruption

Final update

The incident has been resolved.

1. Resolved · May 1, 14:23 UTC
   The incident has been resolved.
2. Monitoring · Apr 30, 21:45 UTC
   The hotfix has been delivered in version 7.33.2
3. Identified · Apr 30, 21:15 UTC
   Coalesce Transform for customers in our North America region experienced a service degradation starting on Wednesday April 29th with the release of 7.33 that is affecting job execution. - Root cause: A change in 7.33 made our node selector matching case-insensitive, which in a rare circumstance, made it possible for newly created jobs enter a recursive job-launch loop. - Current state: We have applied a concurrency limit that prevents runaway job launches and are working on a hotfix to resolve the underlying issue. - Fix inbound ASAP: Hotfix reverting selector matching to case-sensitive is approved and in our release pipeline now. We will update this incident once resolved.