EX Networks incident

LD8 Core Router Disk Failure

Minor Resolved View vendor source →

EX Networks experienced a minor incident on February 6, 2024 affecting Equinix LD8 and IP Transit Services, lasting 7h 2m. The incident has been resolved; the full update timeline is below.

Started
Feb 06, 2024, 04:38 PM UTC
Resolved
Feb 06, 2024, 11:40 PM UTC
Duration
7h 2m
Detected by Pingoru
Feb 06, 2024, 04:38 PM UTC

Affected components

Equinix LD8IP Transit Services

Update timeline

  1. investigating Feb 06, 2024, 04:38 PM UTC

    EXN is currently investigating a potential disk failure on our ASR9001 core router in Equinix LD8. The device is still passing traffic however management functions have been impacted. We have engaged Cisco TAC.

  2. investigating Feb 06, 2024, 05:47 PM UTC

    We are seeing some network instability related to this device. An engineer is en route to site with a replacement.

  3. identified Feb 06, 2024, 07:03 PM UTC

    Engineer is on site. We've adjust various costs and culled our sessions to LONAP & NTT to ensure stability. The device is now servicing only locally connected clients. Spare device is in rack and currently being configured.

  4. identified Feb 06, 2024, 07:31 PM UTC

    EXN will replace the affected device at 19:45 GMT today. We are not expecting any network disruption apart from locally connected clients, who can expect downtime of approximately 1 hour.

  5. identified Feb 06, 2024, 09:10 PM UTC

    We are currently engaged in the emergency replacement of this device. There will be some disruption to locally connected services until the replacement is complete.

  6. monitoring Feb 06, 2024, 10:29 PM UTC

    The device swap has been successfully completed.

  7. resolved Feb 06, 2024, 11:40 PM UTC

    This incident has been resolved.