pool.ntp.org experienced a major incident on June 30, 2018 affecting DNS updates, lasting 2d 9h. The incident has been resolved; the full update timeline is below.
Affected components
DNS updates
Update timeline
- identified Jun 30, 2018, 06:21 PM UTC
About 9.30 UTC the network hosting the server that distributes DNS updates to the GeoDNS servers went down. Monitoring is still up, DNS servers still work, etc, but monitoring updates, servers going down, new servers added etc are not being included.
- monitoring Jul 01, 2018, 05:04 AM UTC
The broken router was fixed (replaced) earlier today. The remaining missing firewall rules were just implemented and the DNS updates are back to updating every few minutes.
- resolved Jul 03, 2018, 04:00 AM UTC
The new router has been stable for a while now. We'll get it's failover peer back up and operational as soon as possible as well.