Moveworks Assistant Impacted by Ongoing Microsoft Outage

Final update

Microsoft has identified that a process on its affected servers, one that handles secure connections, is becoming overwhelmed and causing those servers to stop processing requests. Microsoft is testing a configuration change on a subset of servers before rolling it out more broadly alongside restarts. They’re also reverting a recent network change that lines up with the start of the outage, and have temporarily limited traffic in some locations to help servers stay stable while service is gradually restored. Impact on Moveworks Assistant Notifications and Employee Communications are still delayed across all chat platforms, and Moveworks Assistant replies in Microsoft Teams may still be slow. Moveworks Assistant conversations in all other chat platforms continue to work normally. What we’re doing Our Engineering team is rolling out changes to increase how quickly we can deliver queued notifications. What you can do Please avoid resending campaigns to your full audience, as this adds to the backlog and may cause duplicate messages

1. Identified · Nov 13, 02:06 UTC
   Microsoft has identified that a process on its affected servers, one that handles secure connections, is becoming overwhelmed and causing those servers to stop processing requests. Microsoft is testing a configuration change on a subset of servers before rolling it out more broadly alongside restarts. They’re also reverting a recent network change that lines up with the start of the outage, and have temporarily limited traffic in some locations to help servers stay stable while service is gradually restored. Impact on Moveworks Assistant Notifications and Employee Communications are still delayed across all chat platforms, and Moveworks Assistant replies in Microsoft Teams may still be slow. Moveworks Assistant conversations in all other chat platforms continue to work normally. What we’re doing Our Engineering team is rolling out changes to increase how quickly we can deliver queued notifications. What you can do Please avoid resending campaigns to your full audience, as this adds to the backlog and may cause duplicate messages
2. Identified · Nov 12, 22:04 UTC
   We’ve confirmed that the Microsoft 365 outage (Microsoft incidents MO1550821 and TM1550488) is affecting the following Moveworks services: Moveworks Assistant in Microsoft Teams: Employees may see slow replies or missing notifications. Employee Communications: Campaigns may be delayed for all customers, including those on Slack and other chat platforms. Some campaigns may stay in a scheduled state longer than expected before sending. Moveworks Assistant conversations in Embedded AI Assistant, Employeeworks Web App, Slack, Google Chat, and Zoom are working normally. Microsoft is still restarting and validating affected servers and is evaluating whether rolling back recent configuration changes could speed up recovery. Our Engineering team is monitoring closely and will confirm once service is back to normal. Affected Regions: All
3. Identified · Nov 12, 20:51 UTC
   We are aware of an ongoing Microsoft outage that is affecting some Moveworks AI Assistant users. Microsoft is investigating reports of users having trouble accessing or using Microsoft Teams (Microsoft incident TM1550488). The outage appears to be affecting Moveworks Assistant notifications delivered including Employee Communications, which may be delayed or not delivered. It may also affect ingestion from Microsoft sources. This issue is on Microsoft’s side, and Microsoft is actively working on a fix. Our team is monitoring closely and will confirm once Moveworks notifications are back to normal.