pool.ntp.org incident

Power outage

Resolved after 1 day 23 hours, affecting Management Portal and DNS updates, on December 18, 2020.

identified Dec 23, 2020, 07:00 PM UTC

This has was all settled earlier; no data was lost but monitoring wasn't functional for a number of hours.

Started
Dec 18, 2020, 01:15 AM UTC
Resolved
Dec 20, 2020, 01:00 AM UTC
Duration
1d 23h
Detected by Pingoru
Dec 18, 2020, 01:15 AM UTC

Affected components

Management PortalDNS updates

Update timeline

  1. identified Dec 18, 2020, 01:15 AM UTC

    Equinix Metal had a power outage (https://status.equinixmetal.com/incidents/pfgmgy1fnjcp) in the data center where the monitoring and web servers are hosted. One too many of our servers went down making the distributed file system (barely) unavailable. Power is back and the servers should recover soon. When it comes up we'll review if we can increase replication for the critical services. DNS service was unaffected other than having delayed updates from the monitoring system.

  2. identified Dec 23, 2020, 07:00 PM UTC

    This has was all settled earlier; no data was lost but monitoring wasn't functional for a number of hours.

  3. resolved Dec 23, 2020, 07:01 PM UTC

    This incident has been resolved.

Your product runs on more than pool.ntp.org

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →