Umbrellar incident
Network connectivity failure in Auckland region.
Umbrellar experienced a critical incident on July 14, 2022 affecting Auckland and Auckland, lasting 3h 45m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 14, 2022, 12:58 AM UTC
Core networking services have been disrupted in our Auckland datacentre and this is being investigated and will be resolved as soon as possible. Further updates to follow.
- identified Jul 14, 2022, 01:00 AM UTC
The issue has been identified as the core router in Auckland flapping causing grey failure response. Routing engines have been restarted, and the time issue is related to convergence. Further updates to follow.
- monitoring Jul 14, 2022, 01:02 AM UTC
Networking services have recovered and are under observation by the network engineering team. If you are still experiencing problems, please notify [email protected] or phone 0800 344 493.
- monitoring Jul 14, 2022, 02:10 AM UTC
A restart of the line card in the degraded core router helped restore networking services. Network engineers are still monitoring the situation. If you are still experiencing problems, please notify [email protected] or phone 0800 344 493.
- resolved Jul 14, 2022, 04:47 AM UTC
This incident has been resolved at approximately 12:45pm and subsequent monitoring checks are healthy.