Sauce Labs experienced a minor incident on May 14, 2025 affecting US-West and US-West, lasting 27m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 14, 2025, 04:49 PM UTC
We are currently investigating an issue where video recordings for Android tests are intermittently missing in our US West Datacenter. The issue began on May 13th at approximately 13:00 CEST.
- investigating May 14, 2025, 05:16 PM UTC
We are continuing to investigate this issue.
- resolved May 14, 2025, 05:16 PM UTC
We have identified the root cause and deployed a fix for this issue. This incident is resolved.
- postmortem Jun 13, 2025, 10:44 AM UTC
### **Dates:** Thursday May 13th 2025, 10:26 UTC - Friday May 14th 2025 16:48 UTC ### **What happened:** Video recordings for Android tests intermittently failed in the US-West-1 datacenter. ### **Why it happened:** A service involved in capturing recordings entered a deadlocked state when receiving a specific combination of requests and options. ### **How we fixed it:** We cleared the deadlocked service. ### **What we are doing to prevent it from happening again:** We are introducing additional monitors and automatic recovery for the deadlocked condition.