Missing metrics on statuspage
Timeline · 1 update
- resolved Sep 11, 2026, 10:00 PM UTC
During the incident today we also noticed (belatedly) that the status page metrics updater had been failing because the status page API key had expired, oops.
pool.ntp.org had 4 outages in the last 2 years totaling 5097h 35m of downtime — averaging 0.2 incidents per month.
There were 4 pool.ntp.org outages since September 26, 2025 totaling 5097h 35m of downtime. Each is summarised below — incident details, duration, and resolution information.
During the incident today we also noticed (belatedly) that the status page metrics updater had been failing because the status page API key had expired, oops.
The website (in particular the graphs) had a prolonged outage today. The graphs are back now, but will have some expected maintenance windows in the coming weeks related to the infrastructure migration (see https://news.ntppool.org/ )
The newly reset database cluster (from last night) decided to blow itself up again. I think the extra query load and data from the new monitoring system is making the setup fragile. Investigating.
With a bit of help the kubernetes operator got the cluster working again, at least for now.
The database croaked again! I'm restoring from a ~20 minute old backup.
ok, we are stable again -- hopefully.
System has been migrated to the new infrastructure.