Arcustech incident

US West - Upstream Networking Issues

Major Resolved View vendor source →

Arcustech experienced a major incident on June 15, 2021 affecting US - West, lasting 1h 40m. The incident has been resolved; the full update timeline is below.

Started
Jun 15, 2021, 01:16 AM UTC
Resolved
Jun 15, 2021, 02:57 AM UTC
Duration
1h 40m
Detected by Pingoru
Jun 15, 2021, 01:16 AM UTC

Affected components

US - West

Update timeline

  1. investigating Jun 15, 2021, 01:16 AM UTC

    Staff are seeing random reports from our external monitoring about trouble reaching certain clients/ip ranges in our US West (Fremont, CA) data center location. Staff are working with our data center/upstream provider in Fremont to identify the issues on their network currently. We will update as soon as we have more details.

  2. investigating Jun 15, 2021, 01:37 AM UTC

    We are awaiting further updates but seems the issue is come from issues on one of our data center providers core routers. Again once we have more details we will update this incident.

  3. identified Jun 15, 2021, 01:42 AM UTC

    Looks at though the primary cause is some A and B power circuit outages in certain data halls in our providers data center. This is likely causing impacts to the before mentioned core router, but likely some of the switching equipment between our racks and the data centers core network. At the moment our own equipment does not seem to be affected by this loss of primary and secondary power circuits.

  4. monitoring Jun 15, 2021, 02:19 AM UTC

    The data center's power issues have been corrected, and impact to our network traffic has been returned to normal activity. We will leave this in "Monitoring" for about 15 to 20 minutes just to make sure, and then will auto set this incident to "Resolved". If you are still having any issues, please let our support team know.

  5. resolved Jun 15, 2021, 02:57 AM UTC

    This incident has been resolved.