BitTitan incident

MigrationWiz and MSPComplete are not accepting connections

Critical Resolved View vendor source →

BitTitan experienced a critical incident on February 9, 2022 affecting MSPComplete and MigrationWiz, lasting 2d 19h. The incident has been resolved; the full update timeline is below.

Started
Feb 09, 2022, 05:52 AM UTC
Resolved
Feb 12, 2022, 12:56 AM UTC
Duration
2d 19h
Detected by Pingoru
Feb 09, 2022, 05:52 AM UTC

Affected components

MSPCompleteMigrationWiz

Update timeline

  1. investigating Feb 09, 2022, 05:52 AM UTC

    We are experiencing slower then usual migrations and delay in submission of jobs for "United States" Data center. Our engineering team is currently investigating on the issue.

  2. investigating Feb 10, 2022, 01:45 AM UTC

    INTERNATIONAL INSTANCE of MigrationWiz and MSPComplete is currently not accepting connections or processing submissions. Our engineering team is currently investigating the issue. ETA to resolution is currently unknown. Please continue to monitor this page for updates. (Germany and China instances are not effected) International instance includes : United States, Netherlands, Western Europe, Singapore, Asia Pacific, Australia, Japan, Brazil, South America, Canada, Ireland, Northern Europe, France, South Africa

  3. investigating Feb 10, 2022, 10:16 AM UTC

    Our teams are still working towards the resolution of the issue.

  4. investigating Feb 10, 2022, 04:36 PM UTC

    Our teams are still working towards the resolution of the issue.. At this time we do not have an ETA but this is being treated as critical and all resources available are working towards the quickest resolution possible

  5. identified Feb 11, 2022, 12:35 AM UTC

    We are engaged with Microsoft and working on a fix ETA 2-6 hours

  6. identified Feb 11, 2022, 05:52 AM UTC

    The recovery process is delayed. Latest ETA for fix is 2 - 4 hours.

  7. identified Feb 11, 2022, 10:00 AM UTC

    The recovery process is delayed. Latest ETA for fix is 3 - 5 hours.

  8. identified Feb 11, 2022, 03:00 PM UTC

    Our team is making progress on testing the solution - however our latest ETA on recovery is approximately another 3 hours

  9. identified Feb 11, 2022, 06:03 PM UTC

    We are continuing to work on a fix for this issue.

  10. monitoring Feb 11, 2022, 07:27 PM UTC

    Our teams are continuing to work on the issue. However, MigrationWiz and MSPComplete have been restored and are online. As we continue to work through the issue, please begin with testing your migration scenario to ensure it works as expected for your environment. At this time, we ask that you begin all migration projects with small batches as we are continuing to work through this issue with Microsoft. We will provide more information as it becomes available.

  11. resolved Feb 12, 2022, 12:56 AM UTC

    This incident is resolved.