GearHost incident

Cloudsite Outages

Major Resolved View vendor source →

GearHost experienced a major incident on October 15, 2018 affecting DEN1 and CloudSites and 1 more component, lasting 2d 13h. The incident has been resolved; the full update timeline is below.

Started
Oct 15, 2018, 04:37 AM UTC
Resolved
Oct 17, 2018, 06:33 PM UTC
Duration
2d 13h
Detected by Pingoru
Oct 15, 2018, 04:37 AM UTC

Affected components

DEN1CloudSitesControl Panel

Update timeline

  1. investigating Oct 15, 2018, 04:37 AM UTC

    We are aware of the ongoing issues with our Cloudsite Environment. Our engineers are working around the clock to resolve the issue. As of 7PM MST everything appears to be back to normal. Our team is still monitoring the infrastructure and will publish updates here going forward. If you have any questions or concerns please open a support ticket. Responses will be delayed as we have had a huge influx of inquiries. We apologize for any inconvience that this causes and we will continue working around the clock until this is permantly resolved.

  2. investigating Oct 15, 2018, 01:09 PM UTC

    Our Engineers are still working on this. Outages started occurring again early this morning. We are making progress and plan on having this resolved soon. Thank you for your patience.

  3. investigating Oct 15, 2018, 05:31 PM UTC

    We are aware of the continued outages that occur. Our Engineers have managed to limit them for the time being. We will continue working on this until it is resolved.

  4. investigating Oct 16, 2018, 03:36 PM UTC

    Outages are still occurring, we have managed to limit the downtime as much as we can. Our Engineers are making great progress and working as hard and as fast as they can to get this resolved. Thank you for your patience.

  5. monitoring Oct 16, 2018, 08:08 PM UTC

    A fix has been implemented. Our Engineers will need to wait at least an hour to confirm if the fix works.

  6. identified Oct 16, 2018, 10:13 PM UTC

    The fix that was published did not resolve the issue permanently. We are working closely with Microsoft for a solution. We will update you here as we gather more information.

  7. monitoring Oct 17, 2018, 01:55 PM UTC

    Our engineer team published a new fix last night that should resolve the ongoing outages we have been having. We will continue monitoring our system for the next few hours to confirm the fix is working.

  8. resolved Oct 17, 2018, 06:33 PM UTC

    Our engineers are confident to say that this has finally been resolved. We thank you for your patience. If you are still experiencing problems please open a support ticket.