Shuttlerock incident

SRC Review tool partial outage

Major Resolved View vendor source →

Shuttlerock experienced a major incident on December 8, 2022 affecting Revision UI and Revision API, lasting 45m. The incident has been resolved; the full update timeline is below.

Started
Dec 08, 2022, 04:19 AM UTC
Resolved
Dec 08, 2022, 05:05 AM UTC
Duration
45m
Detected by Pingoru
Dec 08, 2022, 04:19 AM UTC

Affected components

Revision UIRevision API

Update timeline

  1. investigating Dec 08, 2022, 04:19 AM UTC

    We are currently investigating this issue.

  2. investigating Dec 08, 2022, 04:25 AM UTC

    We are continuing to investigate this issue.

  3. identified Dec 08, 2022, 04:25 AM UTC

    The issue has been identified and a fix is being implemented.

  4. monitoring Dec 08, 2022, 04:26 AM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Dec 08, 2022, 05:05 AM UTC

    After monitoring, we can confirm the incident has now been resolved. The ShuttlerockCloud Revision application cache was not successfully invalidated across all regions post-release, and as such several regions were not able to access the revisions application within SRC. Once identified, the cache was successfully invalidated, and the application began behaving as normal again.