Vorco NZ incident

Connectivity issues

Resolved after 14 minutes, affecting Core Network and Internet & WAN Access, on February 24, 2025.

resolved Feb 24, 2025, 02:54 AM UTC

One of our MPLS PE routers suffered from a network loop, causing that device to become overloaded and drop traffic. As this router also hosts one of our internet transit paths, BGP reconvergence (a hard failover) occurred which disrupted connectivity for a few minutes. After shutting down the offending service, the affected router returned to normal. We'll be investigating how this occurred, and apologise for the service interruption. Impact was from 14:52 local time until 15:06 local time.

Started
Feb 24, 2025, 01:52 AM UTC
Resolved
Feb 24, 2025, 02:07 AM UTC
Duration
14m
Detected by Pingoru
Feb 24, 2025, 01:52 AM UTC

Affected components

Core NetworkInternet & WAN Access

Update timeline

  1. investigating Feb 24, 2025, 02:01 AM UTC

    We're investigating connectivity issues between one of our core sites and will update this as soon as we know more.

  2. identified Feb 24, 2025, 02:07 AM UTC

    We've identified the cause and are taking steps to mitigate

  3. resolved Feb 24, 2025, 02:54 AM UTC

    One of our MPLS PE routers suffered from a network loop, causing that device to become overloaded and drop traffic. As this router also hosts one of our internet transit paths, BGP reconvergence (a hard failover) occurred which disrupted connectivity for a few minutes. After shutting down the offending service, the affected router returned to normal. We'll be investigating how this occurred, and apologise for the service interruption. Impact was from 14:52 local time until 15:06 local time.

Your product runs on more than Vorco NZ

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →