GearHost incident

Microsoft SQL Cluster MSSQL01

Major Resolved View vendor source →

GearHost experienced a major incident on November 2, 2018 affecting Databases, lasting 1d 9h. The incident has been resolved; the full update timeline is below.

Started
Nov 02, 2018, 03:09 PM UTC
Resolved
Nov 04, 2018, 12:30 AM UTC
Duration
1d 9h
Detected by Pingoru
Nov 02, 2018, 03:09 PM UTC

Affected components

Databases

Update timeline

  1. identified Nov 02, 2018, 03:09 PM UTC

    We have ran into an issue with the MSSQL01 SQL Server Cluster. If your database is on this cluster then you will have errors trying to connect to your database. All data is intact however the cluster is having an issue with SQL Server 2017. We are working hard on this and everything should be online shortly.

  2. identified Nov 02, 2018, 04:06 PM UTC

    Our Engineers are still working hard on this. We appreciate your patience during this matter. This is a high priority problem, we have our top Engineers working on a solution.

  3. identified Nov 02, 2018, 09:22 PM UTC

    We are working with Microsoft and this should be resolved within the next 90 minutes. We greatly apologize for the delay. Rest assured no data is lost and if you need your database working ASAP please open a ticket and we'll migrate your database to another cluster for you.

  4. monitoring Nov 03, 2018, 05:13 AM UTC

    We have worked with Microsoft however the patches applied have rendered the MSSQL1 cluster offline so we are migrating customers to new clusters. This will be completed in the next few hours however if you would like your database moved more quickly please open a support ticket. Please note only paid databases are being migrated at this point. Free databases will be migrated after paying customers. No data has been lost. You will receive a support ticket email with details shortly.

  5. resolved Nov 04, 2018, 12:30 AM UTC

    In an effort to make things easier we have restored the MSSQL1 database cluster. There was about a 3 hour window from when the failure occured to when the backups took place. If you need data between this time please open a support ticket and we can provide you with a database that has no loss in that time period. Please accept our apologies for this long outage. We worked closely with Microsoft to get this resolved for not only GearHost but other providers like us. On a side note performance of your databases has also dramatically increased. Enjoy!