Vorco NZ experienced a critical incident on October 12, 2023 affecting SkyPhone Standard, lasting 3h 23m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Oct 12, 2023, 06:02 PM UTC
Start Time: 0645 Service(s) Affected: SkyPhone Standard Customer Impact: Due to a datacentre power fault SkyPhone handsets will be unable to register and make calls. We apologise for any inconvenience this may cause.
- identified Oct 12, 2023, 06:54 PM UTC
Electricians are on-site working to resolve power issues. No ETR at this time but this is being treated with the highest priority.
- monitoring Oct 12, 2023, 07:11 PM UTC
Power has been restored and checks are being done by engineers to confirm services are working as expected again.
- monitoring Oct 12, 2023, 08:06 PM UTC
Services should be fully restored, but sometimes phones may not automatically re-register with the network. If your phone is still not working, please power cycle it by removing the power and network from the phone for a moment, then plugging back in.
- resolved Oct 12, 2023, 09:08 PM UTC
This incident has been resolved.
- postmortem Oct 12, 2023, 09:08 PM UTC
The root cause was a loss of grid power in the Auckland CBD this morning and backup generator power failed to come online which led to UPS battery backup running out before the generator could be brought online. This will be followed up with the datacentre operator to determine why generator power failed to come online.