Exascale experienced a minor incident on May 16, 2024 affecting LHR0 - Telehouse North, London, UK and MCR0 - Datum, Manchester, UK, lasting 18h 29m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 16, 2024, 11:56 AM UTC
We are currently observing a high capacity circuit being hard down between Manchester and London. Traffic is routing via alternative paths albet at higher latency.
- identified May 16, 2024, 01:59 PM UTC
Neos Networks is investigating a major incident affecting multiple services due to a suspected fibre break between Evesham and Bradley Stoke. Fibre engineers have been dispatched to pin point the exact location of the break. Updates to follow once engineers have arrived on site and started their investigation.
- identified May 16, 2024, 04:32 PM UTC
Engineers have located extensive cable and duct damage, we are currently assessing a formulating a fix plan with the third party provided.
- monitoring May 16, 2024, 04:33 PM UTC
The fault has been caused by National Grid installing an new pylon and are currently formulating a fix plan. We are monitoring on a hourly basis and will update you accordingly.
- monitoring May 16, 2024, 11:15 PM UTC
We have seen this circuit return into service and traffic reroute. We will continue to monitor untill early morning before closing this incident.
- resolved May 17, 2024, 06:25 AM UTC
We have observed stability for a number of hours. We’re now closing this incident. All traffic continues to route via the shortest path.