Umbrellar incident
Network Services Auckland - Performance Degredation
Umbrellar experienced a minor incident on October 1, 2020 affecting Auckland, lasting 17h 37m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 01, 2020, 04:29 AM UTC
Network engineers are currently investigating reports of packet loss coming in to the Umbrellar Auckland network. There appears to be intermittent packet loss resulting in web pages loading very slowly and timing out. Once the cause has been identified a new update will be provided shortly.
- identified Oct 01, 2020, 04:57 AM UTC
The network packet loss appears to be coming across one of Umbrellar's Megaport peerings. Network engineers will look to reduce preference on Megaport in favour of other peering providers and will asses the outcome.
- monitoring Oct 01, 2020, 06:22 AM UTC
Network latency and response currently stabilised and traffic routes have been mitigated. The team will continue to monitor the situation closely.
- monitoring Oct 01, 2020, 10:29 AM UTC
The team are monitoring network latency. No issues are currently being observed.
- resolved Oct 01, 2020, 10:06 PM UTC
The routing issue at the Megaport Auckland Internet Exchange has been resolved and the Megaport peering is now considered stable. Umbrellar network engineers will begin to route more traffic via Megaport beginning at 11am. Should any customers still experience packet loss, please contact [email protected]