Cloud 66 incident

Subset of Buildgrid Image pushes slower than normal

Minor Resolved View vendor source →

Cloud 66 experienced a minor incident on September 14, 2022 affecting BuildGrid, lasting 4d 18h. The incident has been resolved; the full update timeline is below.

Started
Sep 14, 2022, 08:15 PM UTC
Resolved
Sep 19, 2022, 02:50 PM UTC
Duration
4d 18h
Detected by Pingoru
Sep 14, 2022, 08:15 PM UTC

Affected components

BuildGrid

Update timeline

  1. identified Sep 14, 2022, 08:15 PM UTC

    The team is aware that some Buildgrid pushes are taking longer than normal, and are working on a mitigation strategy

  2. identified Sep 15, 2022, 05:03 PM UTC

    Our engineering team is continuing to look into mitigations for this issue.

  3. monitoring Sep 16, 2022, 11:47 AM UTC

    The team has completed the first part of the mitigation strategy for intermittent slow Buildgrid pushes. We are now monitoring ongoing performance.

  4. resolved Oct 06, 2022, 02:50 PM UTC

    This incident has been resolved.