Sauce Labs experienced a major incident on January 21, 2025 affecting US-West and US-West and 1 more component, lasting 7m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 21, 2025, 01:39 PM UTC
We are currently seeing App installation errors when trying to run iOS tests on our US-West-1 & EU-Central-1 Datacenter. We are investigating
- resolved Jan 21, 2025, 01:46 PM UTC
After taking remedial action, apps are now installing correctly in all datacenters. This incident is resolved.
- postmortem Apr 01, 2025, 04:19 PM UTC
### Dates: Tuesday January 21st 2025, 12:40 - 13:44 UTC ### **What happened:** Tests using iOS Real Devices experienced failures to download and install apps for the eu-central01 and us-west-1 datacenters. **Why it happened:** A misconfiguration with the resigner service caused errors when communicating with the app storage. ### **How we fixed it:** A rollback was executed, restoring configuration to the previous working state. ### **What we are doing to prevent it from happening again:** * Improve canary deployments for each Real Device Cloud region. * Improve end to end testing for canary deployments. * Improve SLOs for the Real Device application installs