Arcustech incident

Chicago, IL, US - Investigating reachability issues to client VPS servers - On Going

Major Resolved View vendor source →

Arcustech experienced a major incident on November 29, 2024 affecting US - Central, lasting 3h 2m. The incident has been resolved; the full update timeline is below.

Started
Nov 29, 2024, 04:28 AM UTC
Resolved
Nov 29, 2024, 07:30 AM UTC
Duration
3h 2m
Detected by Pingoru
Nov 29, 2024, 04:28 AM UTC

Affected components

US - Central

Update timeline

  1. identified Nov 29, 2024, 04:28 AM UTC

    Unfortunately the fix earlier does not seem to have fixed the issue, and avoided multiple monitoring methods we have in place. Because of these ongoing issues our data center provider is going to be moving our servers to a different set of switches/network equipment in the next 2 to 4 hours. We will update this ticket as soon as the work begins, and when its completed. Until they are ready to do the cut over, the systems are back online and serving traffic again. Again we will be leaving this ticket open and updated when the work begins in a few hours for the network cut over.

  2. identified Nov 29, 2024, 05:48 AM UTC

    Our data center provider is done early with their prep work to move our systems over to a new network/switches. We will be initiating the work at 12 midnight Central US time tonight. We are unsure how long each client will be impacted as the move progresses, but our Technical Team here will be monitoring and checking in on each of our VPS client's system(s) availability as the work progresses. We will update this incident once the migration is completed and then after a period of monitoring we will close this incident.

  3. monitoring Nov 29, 2024, 06:44 AM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Nov 29, 2024, 07:30 AM UTC

    This incident has been resolved.