DigitalFyre incident

Network degradation: Ashburn, VA

Notice Resolved View vendor source →

DigitalFyre experienced a notice incident on November 10, 2020 affecting Ashburn, VA, U.S. and Ashburn, VA, U.S., lasting 1d 15h. The incident has been resolved; the full update timeline is below.

Started
Nov 10, 2020, 09:48 PM UTC
Resolved
Nov 12, 2020, 01:22 PM UTC
Duration
1d 15h
Detected by Pingoru
Nov 10, 2020, 09:48 PM UTC

Affected components

Ashburn, VA, U.S.Ashburn, VA, U.S.

Update timeline

  1. identified Nov 10, 2020, 09:48 PM UTC

    Our data center regarding in Ashburn, VA is experiencing an issue with their network which is subsequently affecting us among other providers within the data center itself. At this time, we have all engineers assigned to work this high level case and are working with the data center on restoring connectivity.

  2. identified Nov 11, 2020, 02:01 AM UTC

    [Update] The building had a planned power outage. The data center flipped over to generator power ahead of time out of caution. The refueling company for the generator flipped the EPO (Emergency Power Off) switch while it had a live load. That is primarily what has caused the initial outage. Thank you for your patience and our apologies for this inconvenience.

  3. identified Nov 11, 2020, 07:45 AM UTC

    [Update] Engineers are still working to restore connectivity. We've experienced at least one hardware failure at this point and are looking at getting devices back online as quick as we can.

  4. monitoring Nov 11, 2020, 06:03 PM UTC

    Connectivity is being restored and we are finalizing the necessary work. You'll notice a very brief blip before the end of the business day, which will be due to router and switch reloads. More updates will be posted shortly.

  5. monitoring Nov 12, 2020, 01:22 PM UTC

    We are continuing to monitor for any further issues.

  6. resolved Nov 12, 2020, 01:22 PM UTC

    This has been completely resolved and all the network tests are successful.