Vorco NZ incident

Unplanned Event - Chorus ADSL/VDSL/HSNS intermittent fault

Minor Resolved View vendor source →

Vorco NZ experienced a minor incident on February 25, 2019 affecting Internet & WAN Access, lasting 1d 1h. The incident has been resolved; the full update timeline is below.

Started
Feb 25, 2019, 07:07 PM UTC
Resolved
Feb 26, 2019, 08:08 PM UTC
Duration
1d 1h
Detected by Pingoru
Feb 25, 2019, 07:07 PM UTC

Affected components

Internet & WAN Access

Update timeline

  1. identified Feb 25, 2019, 07:07 PM UTC

    Start Time: 0058 hours Service(s) Affected: ADSL, VDSL and Auckland HSNS services Customer Impact: Loss of service for approximately 5 minutes each time. A line card in a Chorus switch is spontaneously rebooting at random intervals, which is causing ADSL, VDSL and Auckland HSNS services to go down for around 5 minutes each time. Chorus are aware of and investigating the cause. We apologise for any inconvenience this may cause.

  2. identified Feb 25, 2019, 09:30 PM UTC

    A Chorus technician is on-site currently. If a line card reseat does not restore stability then hardware replacement will be required. Further updates will be provided as soon as the situation changes.

  3. identified Feb 25, 2019, 10:12 PM UTC

    Chorus are arranging hardware replacement now with their equipment vendor to occur as soon as possible.

  4. identified Feb 25, 2019, 11:04 PM UTC

    Chorus have advised a technician has picked up the replacement parts and expects to be on-site within 15 minutes to commence replacement.

  5. monitoring Feb 26, 2019, 01:01 AM UTC

    Chorus re-seated the line card again at 1258 hours and no further loss of connectivity has been observed since. To avoid an extended outage during business hours, full card replacement (which takes longer) will only occur if the handover port loses connectivity again.

  6. resolved Feb 26, 2019, 08:08 PM UTC

    No further issues have been observed since the card reseat so we're closing this out now.