Degraded sync & analysis performance

Final update

We have mitigated the effects of the additional load on our analysis pipeline. No customers are experiencing unexpected delays.

1. Resolved · Mar 2, 21:06 UTC
   We have mitigated the effects of the additional load on our analysis pipeline. No customers are experiencing unexpected delays.
2. Monitoring · Feb 28, 05:33 UTC
   We've rolled out our new sync architecture to all customers and we're now seeing the system behaving as expected. Analysis remains affected by the influx of activity and we're working on architectural fixes for that portion of the pipeline now.
3. Monitoring · Feb 25, 06:18 UTC
   We've now rolled out our upgraded architecture to 80% of customers and will continue to increase this number tomorrow.
4. Monitoring · Feb 24, 07:21 UTC
   We've now rolled out our upgraded architecture to 25% of customers and will continue to increase this number tomorrow.
5. Monitoring · Feb 22, 22:15 UTC
   We will continue to monitor the efficacy of our upgraded architecture for the rest of the weekend before rolling it out more broadly next week.
6. Monitoring · Feb 21, 20:34 UTC
   We're continuing to roll out our upgraded architecture to more customers. Most customers will still see delays of 24-48 hours in their dashboards currently.
7. Identified · Feb 20, 20:22 UTC
   We're rolling out a more scalable architecture and testing with initial set of customers. Other affected customers should see less latency on syncs and analyses as our additional resources have had a chance to progress through the backlog of tasks.
8. Identified · Feb 18, 15:11 UTC
   We have identified a problem with our sync and analysis infrastructure being overwhelmed by influxes of new data. We have dedicated more resources to work through the backlog and we are currently implementing a longer-term fix. You may notice your data for certain sources is delayed by 24-48 hours while we continue to catch up on our backlog.