Is Tornado Datacenter down?

Due to a electrical problem, cooling has been impacted in Rackroom A of TornadoDC FRA1. We're currently working on restoring the same, mid the incident we have deployed backup cooling units to tackle the temperature. On-Duty personnel is working to reduce temperatures on a normal level.

Temperatures are normalizing into SLA range levels. We're monitoring the infrastructure and investigating it's state.

Temperatures in the cold aisle have returned to earlier levels, currently at around 22-24°C. On-Duty personnel is on-site to keep monitoring operations and make adjustments if necessary.

This incident has been resolved.

At 18:31 CEST, the on-call engineer was paged due to rapidly increasing temperatures across Rack Room A. Upon receiving the alerts, the incident was escalated internally at 18:33 CEST. Simultaneously, the on-call engineer departed for the datacenter to respond on-site. Following the escalation, additional team members joined the incident response. As an immediate mitigation measure, backup air conditioning units were activated at 18:34 CEST. Due to the elevated ambient temperatures, the firewall providing remote access to the datacenter infrastructure shut down automatically. At 18:39 CEST, the on-duty engineer arrived on-site and verified the availability of electrical power and the chilled water generation system. Both systems were operating normally and showed no indications of failure. At 18:43 CEST, the on-duty engineer identified an electrical fault affecting the cold-air circulation within the cold aisle of Rack Room A. Power to the free-cooling infrastructure was restored immediately. In addition, the chilled water supply temperature was reduced to increase cooling capacity and accelerate the recovery of room temperatures. We will use the findings from this incident to further strengthen the resilience of our infrastructure. The identified lessons learned will be incorporated into our engineering, monitoring, and operational procedures to reduce the likelihood and impact of similar incidents in the future.

We're currently closely monitoring the ongoing heatwave across Europe, with daytime temperatures exceeding 40°C. To ensure business continuity, we implemented several measures in advance: - The datacenter is cooled using a chilled water system, which has been verified to operate within the manufacturer's specified ambient temperature range - Adiabatic pre-cooling has been added to the chilled water system to reduce the temperature of incoming air before it reaches the mechanical cooling equipment - The datacenter is currently operating in recirculation mode. Outside-air free-cooling dampers are closed to maximize cooling efficiency during the heatwave. - Grid power quality is continuously monitored, and standby emergency generators are available to seamlessly take over the electrical load if required - Our datacenter on-call engineers are continuously monitoring operational metrics, with particular attention during peak temperature periods We do not expect operational instability following implementations made since 2025.

We're closing the same, since the infrastructure dealt with the heatwave flawlessly. Outside temperatures were hitting 41°C past days.

At 10:27 CEST, we experienced a power dip on the public power grid, causing a collapse of the supplied voltage. The UPS systems took over the load, keeping the servers supply at regular voltage levels.

On-Site engineers investigating a current issue with aircon unit #2 appearing to be a electrical problem with the outside unit (condensor). We have temporarily increased supply temperature on other units to stabilize cold aisle temperature.

The unit is currently out of service due to a triggered security valve on the refrigeration circuit, likely causing impact to the refrigeration loop. We're cooling the datacenter with the working cooling units and have informed the maintenance company about the same.

On-Site engineers still monitoring the situation while the unit is out of service and being repaired.

We will provide more details in a planned post-mortem. Temperatures throughout the data hall are stable since the incident happened in the morning, meaning redundancy works as intended. We observe a operational temperature range of about 25.4°C median across all cabinet cold aisle inlet sensors. On-Site engineers monitoring the situation until we have switched back thermal loads to free cooling later in the day. We will leave cold air supply increased, until repair operations are finished. For the upcoming week, we expect the pipe construction company to finish welding works on our new cold water loop network. The same supplies our in-house engineered cooling solution called deltaflow, offering advanced cooling output.

On 10th May 2026, 10:12 CEST, we experienced a failure of aircon unit #2 within RR.A. The issue was caused by a failure of the refrigeration loop due to a electrical issue with the outside condensor, causing blower fans to stop operating properly. The said issue caused increased pressure, which triggered a safety valve within the refrigeration loop, right after the compressor of the unit. Due to the triggered security valve, the unit was unable to cool properly anymore. Since the devices do not stop the inside EC fan, which is situated right after the vaporizer, the unit sucked warm air back into the cold aisle, causing a short temperature spike of up to 28°C. As of 10:18 CEST, on call duty received alarms about raising temperature within the cold aisle. Our first mitigation in such a case is the checking of cold aisle sensors and increase of supply temperature - either through other aircon units or through direct free cooling. We choose to increase the supply of cold air from direct free cooling due to current low outside temperatures. The system was now adding 20.000m³/h additional cold air to the datacenter. At the same time, we reduced temperatures of remaining aircon units. We were able to keep temperatures at a normal range of about ~25°C across the cold aisle of RR.A. On-Site personnel qualified to work on electrical circuits was called at 10:21 CEST and started investigating at 10:26 CEST the same at the outside unit, identifying a supply issue. We escalated the same further to the air conditioning company, who’s responsible for the stable operation of the same. The unit was repaired and cooling restarted. We are aware that technical defects can cause cooling abruptly to stop. For that reason, Tornado Datacenter operates multiple isolated air condition units, supplying cold air. Due to the increased electrical demands of colocation customers, we started to implement a n\+1 redundant cold water system. The same works in concert with our in-house engineered air-water heat-exchanger architecture, which is about to be taken live in the next week.