Percy incident

Timeouts in Percy Safari on iPhone (Beta) builds

Minor Resolved View vendor source →

Percy experienced a minor incident on May 23, 2022 affecting Rendering infrastructure, lasting 1h 41m. The incident has been resolved; the full update timeline is below.

Started
May 23, 2022, 02:06 PM UTC
Resolved
May 23, 2022, 03:47 PM UTC
Duration
1h 41m
Detected by Pingoru
May 23, 2022, 02:06 PM UTC

Affected components

Rendering infrastructure

Update timeline

  1. identified May 23, 2022, 02:06 PM UTC

    The issue has been identified and a fix is being implemented.

  2. monitoring May 23, 2022, 02:15 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. monitoring May 23, 2022, 02:23 PM UTC

    We are continuing to monitor for any further issues.

  4. resolved May 23, 2022, 03:47 PM UTC

    Percy rendering infrastructure was down for Safari on iPhone beta platform which affected a subset of our customers enrolled in beta from 4.28 AM PDT to 7:10 AM PDT. This happened due to a deployment pipeline issue in our Safari on iPhone infra and has since been patched. We apologize for the inconvenience caused and will be doing an RCA on our end to avoid this in future.