Sauce Labs incident

2024-October-11 Resolved Service Incident 2

Notice Resolved View vendor source →

Sauce Labs experienced a notice incident on October 11, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Oct 11, 2024, 07:27 PM UTC
Resolved
Oct 11, 2024, 07:26 PM UTC
Duration
Detected by Pingoru
Oct 11, 2024, 07:27 PM UTC

Update timeline

  1. resolved Oct 11, 2024, 07:27 PM UTC

    Between 9:33 and 19:21 UTC, Real Device tests running via Sauce Connect tunnel (version 5) experienced failures on US-West-1 and EU-Central-1 and US-East-4 Data centers. We have identified the issue and taken remedial action.

  2. postmortem Apr 01, 2025, 03:59 PM UTC

    ### **Dates:** Friday October 11th 2024, 09:19 - 19:19 UTC ### **What happened:** Real Device tests using Sauce Connect 5 tunnels experienced failures in all datacenters. ### **Why it happened:** An improperly tested change to Sauce Connect service was rolled out. ### **How we fixed it:** The sauce connect service was rolled back to a previously working version. ### **What we are doing to prevent it from happening again:** Fixes to post-deploy checks are planned to prevent this issue from reoccurring.