Exascale incident

Fibre break from Wolverhampton to West Bromwich

Notice Resolved View vendor source →

Exascale experienced a notice incident on July 12, 2025 affecting WLV0 - Exascale, Wolverhampton, UK and West Bromwich, lasting 8h 53m. The incident has been resolved; the full update timeline is below.

Started
Jul 12, 2025, 06:51 AM UTC
Resolved
Jul 12, 2025, 03:45 PM UTC
Duration
8h 53m
Detected by Pingoru
Jul 12, 2025, 06:51 AM UTC

Affected components

WLV0 - Exascale, Wolverhampton, UKWest Bromwich

Update timeline

  1. investigating Jul 12, 2025, 06:51 AM UTC

    We’re currently observing a fibre break towards our West Bromwich network. We have raised a fault with the supplier.

  2. identified Jul 12, 2025, 07:47 AM UTC

    After further investigation we are seeing a line-card has failed in our Wolverhampton POP. This particular card is hosting all the local Openreach circuits facing businesses and also our West Bromwich network. We are attempting to reseat the card to remedy the issue.

  3. identified Jul 12, 2025, 07:47 AM UTC

    We are continuing to work on a fix for this issue.

  4. identified Jul 12, 2025, 08:21 AM UTC

    Reseating the linecard has not resolved the issue, we have placed an order for a replacement line card but this will not arrived till Tuesday of next week. We are currently working a temp solution to restore service in the mean time. Next update in 2 hours.

  5. identified Jul 12, 2025, 08:37 AM UTC

    We have sourced temp hardware and an engineer will be installing circa 12 noon and re-routing the circuits facing the faulty line card.

  6. identified Jul 12, 2025, 12:48 PM UTC

    Engineers are on-site implementing the work around.

  7. identified Jul 12, 2025, 12:55 PM UTC

    The workaround has now been implemented and we are starting to see services recover.

  8. monitoring Jul 12, 2025, 12:55 PM UTC

    We're now monitoring the situation.

  9. resolved Jul 12, 2025, 03:45 PM UTC

    We have seen traffic passing for a number of hours and are happy the temp fix has resolved the issue and brought services back into service. A maintiance window will be required to carry out the permanent fix next week.