Vorco NZ experienced a major incident on February 24, 2025 affecting Core Network and Internet & WAN Access, lasting 14m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 24, 2025, 02:01 AM UTC
We're investigating connectivity issues between one of our core sites and will update this as soon as we know more.
- identified Feb 24, 2025, 02:07 AM UTC
We've identified the cause and are taking steps to mitigate
- resolved Feb 24, 2025, 02:54 AM UTC
One of our MPLS PE routers suffered from a network loop, causing that device to become overloaded and drop traffic. As this router also hosts one of our internet transit paths, BGP reconvergence (a hard failover) occurred which disrupted connectivity for a few minutes. After shutting down the offending service, the affected router returned to normal. We'll be investigating how this occurred, and apologise for the service interruption. Impact was from 14:52 local time until 15:06 local time.