House of Control incident

[Complete Control] - Service Disruption in Cloud region

Major Resolved View vendor source →

House of Control experienced a major incident on October 21, 2023 affecting Complete Control, Region - Cloud, lasting 3d 3h. The incident has been resolved; the full update timeline is below.

Started
Oct 21, 2023, 06:00 AM UTC
Resolved
Oct 24, 2023, 09:16 AM UTC
Duration
3d 3h
Detected by Pingoru
Oct 21, 2023, 06:00 AM UTC

Affected components

Complete Control, Region - Cloud

Update timeline

  1. investigating Oct 23, 2023, 08:14 AM UTC

    We are currently experiencing a disruption causing slow or unresponsive service in our Cloud region. Our Operations team is working to identify the root cause and implement a solution. We will send an additional update in 60 minutes or less.

  2. monitoring Oct 23, 2023, 09:11 AM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Oct 24, 2023, 09:16 AM UTC

    We have been monitoring the service for 24 hours following an issue caused by resource depletion on one of our servers. Thankfully, there have been no new issues during this period. New metrics have been added to our monitoring system, and alarms have been set up. This will enable our operations team to catch similar events in the future before they can affect our services.