Vorco NZ incident

IPv4 international connectivity issues

Critical Resolved View vendor source →

Vorco NZ experienced a critical incident on September 3, 2021 affecting Internet & WAN Access, lasting 2h 19m. The incident has been resolved; the full update timeline is below.

Started
Sep 03, 2021, 01:22 AM UTC
Resolved
Sep 03, 2021, 03:41 AM UTC
Duration
2h 19m
Detected by Pingoru
Sep 03, 2021, 01:22 AM UTC

Affected components

Internet & WAN Access

Update timeline

  1. identified Sep 03, 2021, 01:35 AM UTC

    We have lost our international transit IPv4 BGP sessions. This has been confirmed as a fault on the upstream side. IPv6 is working, and our other IPv4 transit/peering sessions are working.

  2. identified Sep 03, 2021, 02:13 AM UTC

    International transit to our AKL4 site has returned but there is still no connectivity to our AKL2 site.

  3. identified Sep 03, 2021, 02:55 AM UTC

    We've implemented a workaround to re-route all traffic via our AKL4 site and all customers should now have connectivity again. We're continuing to work on getting AKL2 international connectivity restored.

  4. monitoring Sep 03, 2021, 03:26 AM UTC

    Our AKL2 site now has international connectivity again and both paths are restored. We're leaving this incident open for the time being until we confirm stability.

  5. resolved Sep 03, 2021, 03:41 AM UTC

    This incident is resolved. The cause was a DDoS attack against one of our international transit providers. Domestic traffic and peering was not affected, and IPv6 international transit was not affected.