Flightcontrol experienced a major incident on June 29, 2026 affecting Metrics, lasting 1d 21h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 29, 2026, 01:03 AM UTC
We are investigating issues with customer facing metrics in the fly-metrics.net dashboard. Users may see delayed or missing metrics at this time.
- identified Jun 29, 2026, 01:46 AM UTC
We've identified an issue on multiple hosts causing delayed metric ingestion into our hosted fly-metrics.net dashboards. We are working on a fix.
- identified Jun 29, 2026, 02:58 AM UTC
We are continuing to see delayed metric exports from a number of hosts. Users will see delayed or missing metrics for machines on impacted hosts at this time.
- identified Jun 29, 2026, 05:34 AM UTC
We are continuing to see delayed metrics due to resource contention on a subset of metrics ingestion hosts, and we are working to rebalance ingestion traffic and reduce the backlog.
- identified Jun 29, 2026, 08:43 AM UTC
We are still in the process of increasing the metrics cluster throughput to catch up with metric backlog.
- identified Jun 29, 2026, 03:56 PM UTC
Metric ingestion is still delayed for some customers. We’re seeing gradual improvement and continue to monitor the situation while the system catches up.
- identified Jun 29, 2026, 08:02 PM UTC
Backlogged metrics data is still being processed, continue to monitor the situation while the system catches up.
- identified Jun 30, 2026, 12:58 AM UTC
Backlogged metrics are still being processed and ingestion delays persist for some customers, but we’re continuing to see gradual improvement as the backlog continues to drain.
- identified Jun 30, 2026, 05:17 AM UTC
Backlogged metrics are still being processed and ingestion delays persist for some customers
- identified Jun 30, 2026, 04:50 PM UTC
Backlogged metrics are still being processed. We're bringing extra processing capacity online to speed up the process.
- identified Jun 30, 2026, 07:58 PM UTC
Almost all metrics have caught up aside from a small handful in `sin` and `syd`. We're continuing to monitor and expect these to complete in the next few hours.
- resolved Jun 30, 2026, 10:19 PM UTC
This incident has been resolved.