EX Networks incident
Fibre Issue - Telehouse East to Virtus Enfield
EX Networks experienced a minor incident on October 4, 2020 affecting DC Connect and IP Transit Services and 1 more component, lasting 1d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 04, 2020, 09:57 PM UTC
At approximately 22:33 today our fibre link between Virtus Enfield and Telehouse East went down. We believe this may be a fibre cut and we are currently raising the issue with our fibre provider. All network services have successfully failed over to other paths, however the site should be considered AT RISK during this time.
- investigating Oct 05, 2020, 07:39 AM UTC
Our fibre provider is currently on site at Telehouse East. Their engineers have finished taking OTDR measurements which are currently being analysed. We expect further updates shortly. All services remain stable.
- identified Oct 05, 2020, 08:43 AM UTC
Our fibre provider has analysed the results of the OTDR which shows a break 13km from Telehouse East. They have engaged their OSP manager to dispatch a fibre splicing crew to the break, we are awaiting an ETA.
- monitoring Oct 05, 2020, 07:56 PM UTC
At 20:31 BST we saw the service between THE and ENF restored, light levels look the same as before the fibre cut and the ports are error free. Once we have assurances from our provider and seen a peroid of stability, we will put the link back into production and obtain an RFO in due course. EXN are disappointed about the amount of time this has taken to restore, and we will be raising this concerns with our provider. Reundancy to Virtus Enfield has now been restored.
- resolved Oct 05, 2020, 11:24 PM UTC
The link between Virtus Enfield and Telehouse East has now been put back into production and full redundancy to Virtus Enfield has been restored. This incident has now been resolved.