Resolved after 27 minutes, affecting US-West and US-West, on May 14, 2025.
### **Dates:** Thursday May 13th 2025, 10:26 UTC - Friday May 14th 2025 16:48 UTC ### **What happened:** Video recordings for Android tests intermittently failed in the US-West-1 datacenter. ### **Why it happened:** A service involved in capturing recordings entered a deadlocked state when receiving a specific combination of requests and options. ### **How we fixed it:** We cleared the deadlocked service. ### **What we are doing to prevent it from happening again:** We are introducing additional monitors and automatic recovery for the deadlocked condition.
Affected components
Update timeline
- investigating May 14, 2025, 04:49 PM UTC
We are currently investigating an issue where video recordings for Android tests are intermittently missing in our US West Datacenter. The issue began on May 13th at approximately 13:00 CEST.
- investigating May 14, 2025, 05:16 PM UTC
We are continuing to investigate this issue.
- resolved May 14, 2025, 05:16 PM UTC
We have identified the root cause and deployed a fix for this issue. This incident is resolved.
- postmortem Jun 13, 2025, 10:44 AM UTC
### **Dates:** Thursday May 13th 2025, 10:26 UTC - Friday May 14th 2025 16:48 UTC ### **What happened:** Video recordings for Android tests intermittently failed in the US-West-1 datacenter. ### **Why it happened:** A service involved in capturing recordings entered a deadlocked state when receiving a specific combination of requests and options. ### **How we fixed it:** We cleared the deadlocked service. ### **What we are doing to prevent it from happening again:** We are introducing additional monitors and automatic recovery for the deadlocked condition.
Your product runs on more than Sauce Labs
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services