Shuttlerock incident

Service interruption - access issues

Major Resolved View vendor source →

Shuttlerock experienced a major incident on April 21, 2024 affecting Order API and Order UI and 1 more component, lasting 2h 51m. The incident has been resolved; the full update timeline is below.

Started
Apr 21, 2024, 11:54 PM UTC
Resolved
Apr 22, 2024, 02:45 AM UTC
Duration
2h 51m
Detected by Pingoru
Apr 21, 2024, 11:54 PM UTC

Affected components

Order APIOrder UIRevision UIRevision API

Update timeline

  1. investigating Apr 21, 2024, 11:54 PM UTC

    Some of the services in ShuttlerockCloud are currently degraded. This is causing SRC to not display project information on the homepage along with limiting access to briefs and projects. We're actively investigating this issue, and we'll post an update as soon as we discover the cause.

  2. identified Apr 22, 2024, 12:22 AM UTC

    Our production cluster became degraded, although it’s still unclear exactly what triggered the problem.

  3. monitoring Apr 22, 2024, 12:23 AM UTC

    We've fixed the network related issue and recycled the failing apps in order to restore service, and will continue to monitor for a period to ensure everything's back to normal.

  4. resolved Apr 22, 2024, 02:45 AM UTC

    This incident has now been resolved.