Sauce Labs incident

2025-October-28 Resolved Service Incident 1

Resolved after 1 hour 6 minutes, on October 28, 2025.

postmortem Dec 11, 2025, 04:33 PM UTC

### **Dates:** Thursday, October 9th 2025, 10:28 UTC - Tuesday, November 11th 2025, 11:34 UTC. ### **What happened:** Virtual Android testing availability gradually decreased in the US-West-1 data center, this led to increased error rates in starting sessions, The error rates remained high between November 4th and November 11th. ### **Why it happened:** An increased and sustained load on our service led to reduced availability of Android virtual VMs, increasing wait times to start sessions, which in turn led to an elevated number of failed sessions. ### **How we fixed it:** This was resolved by increasing infrastructure capacity and optimizing resource utilization. ### **What we are doing to prevent it from happening again:** We have improved monitoring & alerting, enhanced post-deployment validation and improved capacity planning.

Started
Oct 28, 2025, 10:28 AM UTC
Resolved
Oct 28, 2025, 11:34 AM UTC
Duration
1h 6m
Detected by Pingoru
Oct 28, 2025, 10:28 AM UTC

Update timeline

  1. resolved Oct 28, 2025, 05:20 PM UTC

    Between 11:20 UTC and 12:10 UTC, we experienced a high error rate of virtual Android tests in the US-West-1 data center. This issue has been resolved. All services are fully operational.

  2. postmortem Dec 11, 2025, 04:33 PM UTC

    ### **Dates:** Thursday, October 9th 2025, 10:28 UTC - Tuesday, November 11th 2025, 11:34 UTC. ### **What happened:** Virtual Android testing availability gradually decreased in the US-West-1 data center, this led to increased error rates in starting sessions, The error rates remained high between November 4th and November 11th. ### **Why it happened:** An increased and sustained load on our service led to reduced availability of Android virtual VMs, increasing wait times to start sessions, which in turn led to an elevated number of failed sessions. ### **How we fixed it:** This was resolved by increasing infrastructure capacity and optimizing resource utilization. ### **What we are doing to prevent it from happening again:** We have improved monitoring & alerting, enhanced post-deployment validation and improved capacity planning.

Your product runs on more than Sauce Labs

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →