Tornado Datacenter experienced a minor incident on July 3, 2026 affecting Air Conditioning, lasting 32m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jul 03, 2026, 05:06 PM UTC
Due to a electrical problem, cooling has been impacted in Rackroom A of TornadoDC FRA1. We're currently working on restoring the same, mid the incident we have deployed backup cooling units to tackle the temperature. On-Duty personnel is working to reduce temperatures on a normal level.
- identified Jul 03, 2026, 05:15 PM UTC
Temperatures are normalizing into SLA range levels. We're monitoring the infrastructure and investigating it's state.
- identified Jul 03, 2026, 05:38 PM UTC
Temperatures in the cold aisle have returned to earlier levels, currently at around 22-24°C. On-Duty personnel is on-site to keep monitoring operations and make adjustments if necessary.
- resolved Jul 03, 2026, 05:38 PM UTC
This incident has been resolved.
- postmortem Jul 03, 2026, 05:38 PM UTC
At 18:31 CEST, the on-call engineer was paged due to rapidly increasing temperatures across Rack Room A. Upon receiving the alerts, the incident was escalated internally at 18:33 CEST. Simultaneously, the on-call engineer departed for the datacenter to respond on-site. Following the escalation, additional team members joined the incident response. As an immediate mitigation measure, backup air conditioning units were activated at 18:34 CEST. Due to the elevated ambient temperatures, the firewall providing remote access to the datacenter infrastructure shut down automatically. At 18:39 CEST, the on-duty engineer arrived on-site and verified the availability of electrical power and the chilled water generation system. Both systems were operating normally and showed no indications of failure. At 18:43 CEST, the on-duty engineer identified an electrical fault affecting the cold-air circulation within the cold aisle of Rack Room A. Power to the free-cooling infrastructure was restored immediately. In addition, the chilled water supply temperature was reduced to increase cooling capacity and accelerate the recovery of room temperatures. We will use the findings from this incident to further strengthen the resilience of our infrastructure. The identified lessons learned will be incorporated into our engineering, monitoring, and operational procedures to reduce the likelihood and impact of similar incidents in the future.