Arcustech incident

US Central - v.2 Platform - Single Physical Server Issue - Continued

Major Resolved View vendor source →

Arcustech experienced a major incident on August 23, 2020, lasting 1h 12m. The incident has been resolved; the full update timeline is below.

Started
Aug 23, 2020, 05:32 AM UTC
Resolved
Aug 23, 2020, 06:44 AM UTC
Duration
1h 12m
Detected by Pingoru
Aug 23, 2020, 05:32 AM UTC

Update timeline

  1. identified Aug 23, 2020, 05:32 AM UTC

    Unfortunately the storage system issue has not gone away. We are emergency moving clients off of this server as quickly as possible to one of our standby servers. This will unfortunately take time, but based on the work already underway there is again no data loss happening with this incident currently. We will update this as work progresses.

  2. identified Aug 23, 2020, 06:04 AM UTC

    So far about 25%-30% of impacted clients have been moved to the replacement physical server and had service restored. We are closely monitoring the migration process to get it done as quickly as possible.

  3. identified Aug 23, 2020, 06:18 AM UTC

    We are at about 50% of clients being restored to service at this point. We will update again shortly.

  4. identified Aug 23, 2020, 06:29 AM UTC

    75% of clients impacted by this physical server issue have now been restored.

  5. resolved Aug 23, 2020, 06:44 AM UTC

    100% of impacted clients have been migrated to the replacement server. All client systems are showing green/operational at this time. If you are having any issues still, please open a support ticket. Thank you, and sorry for the impact this caused tonight.