Tornado Datacenter Outage History

Started Aug 09, 2026, 03:31 PM UTC· resolved Aug 09, 2026, 03:49 PM UTC

1. identified Aug 09, 2026, 03:31 PM UTC

   We're currently monitoring a outage of the public power grid connection for TornadoDC FRA1. The datacenter has switched over to generator power supply and is supplied from there, UPSes took over the load until generator load transfer. We're investigating the issue.

2. resolved Aug 09, 2026, 03:49 PM UTC

   We had a defective fuse in the building NSHV. The same has been exchanged, the facility has switched back to regular grid supply.

3. postmortem Aug 11, 2026, 09:50 AM UTC

   The incident was caused by the failure of an NH fuse within the building’s main low-voltage switchboard \(NSHV\), specifically within the section supplying Tornado Datacenter. To mitigate the impact of such upstream power failures, Tornado Datacenter operates an automatic standby generator system that continuously monitors the quality and availability of the public grid supply. If grid parameters fall outside the defined operating limits, the generator starts automatically. Once generator voltage and frequency are stable and within specification, the datacenter’s electrical infrastructure automatically transfers the load to generator supply. The complete process takes approximately 20 seconds. During this transition period, the datacenter load is supplied without interruption by multiple UPS systems operating from battery power. The entire emergency power chain is tested every three months as part of scheduled black-building simulations. During these tests, the public grid supply to the datacenter is intentionally disconnected for approximately one hour to verify the operation of the UPS systems, automatic generator start, load transfer, sustained generator operation, and subsequent return to utility power. During the incident in question, the public grid supply to the datacenter became unavailable following the failure of the upstream NH fuse. As designed, the UPS systems immediately maintained power to the datacenter while the standby generator started and assumed the load. Qualified in-house electrical engineers subsequently identified and replaced the failed fuse. After the building supply had been restored and verified, the datacenter infrastructure automatically transferred back from generator operation to the public grid. The underlying cause was an increased electrical load associated primarily with higher cooling demand and the rapid growth of Tornado Datacenter. Several heatwaves during summer 2026, combined with the operation of the newly implemented chilled-water cooling system, resulted in significantly higher peak loads. Over a period of several months, repeated operation close to the fuse’s thermal limits led to progressive thermal ageing and ultimately caused the fuse to operate during a peak-load condition. As a long-term capacity expansion, we are currently planning the implementation of a new transformer substation, which is scheduled to become operational in the first quarter of 2027. This expansion will substantially increase the available electrical capacity and provide additional headroom for the continued growth of the datacenter, especially capacity in future Room B \(~1MW\).

Read the full incident report →

Started Aug 06, 2026, 11:32 AM UTC· resolved Aug 15, 2026, 05:37 PM UTC

1. monitoring Aug 06, 2026, 11:32 AM UTC

   TornadoDC is currently monitoring increased cooling demand caused by elevated solar heat gain. Due to the ongoing roof modernization above the datacenter, the roof insulation has been temporarily removed, resulting in a significantly higher thermal load on the facility and increased power consumption by the cooling infrastructure. As a precautionary measure, we have activated additional cooling capacity to maintain stable operating conditions. We have also ordered additional equipment to further strengthen the site's cooling capabilities during the remaining construction period. The measured temperature within the cold aisle remains well within our SLA-guaranteed limits, and there is no impact on customer services. The building owner and the construction contractor have been informed of the situation. We have received confirmation that the affected roof section above the datacenter has been prioritized and that work on this area will be completed as quickly as possible. We will continue to closely monitor the situation and provide further updates if necessary.

2. monitoring Aug 10, 2026, 07:07 AM UTC

   We got informed by the building owner, the contractor responsible for the roof modernization will start the works as of today in order to restore outer insulation above the datacenter.

3. monitoring Aug 11, 2026, 09:38 AM UTC

   In coordination with the manufacturer of the chilled-water system, we have implemented several optimizations to maintain more stable temperatures while reducing capacity fluctuations. Temporary roof insulation has also been installed to minimize additional heat gain. Additional cooling equipment is scheduled for delivery tomorrow, providing increased thermal capacity and additional headroom for the remainder of the 2026 summer season. This will allow the existing DX air-conditioning units to remain reserved for emergency and exceptional operating conditions, such as the current situation, rather than being required during normal operation. In summer 2027, the existing DX air-conditioning units will be replaced with in-row CRAH units, further increasing cooling capacity and improving overall efficiency and temperature stability.

4. resolved Aug 15, 2026, 05:37 PM UTC

   We're closing the same, cold aisle temperatures were stable over the past days and behaved as planned.

Read the full incident report →

Started Jul 03, 2026, 05:06 PM UTC· resolved Jul 03, 2026, 05:38 PM UTC

1. identified Jul 03, 2026, 05:06 PM UTC

   Due to a electrical problem, cooling has been impacted in Rackroom A of TornadoDC FRA1. We're currently working on restoring the same, mid the incident we have deployed backup cooling units to tackle the temperature. On-Duty personnel is working to reduce temperatures on a normal level.

2. identified Jul 03, 2026, 05:15 PM UTC

   Temperatures are normalizing into SLA range levels. We're monitoring the infrastructure and investigating it's state.

3. identified Jul 03, 2026, 05:38 PM UTC

   Temperatures in the cold aisle have returned to earlier levels, currently at around 22-24°C. On-Duty personnel is on-site to keep monitoring operations and make adjustments if necessary.

4. resolved Jul 03, 2026, 05:38 PM UTC

   This incident has been resolved.

5. postmortem Jul 03, 2026, 05:38 PM UTC

   At 18:31 CEST, the on-call engineer was paged due to rapidly increasing temperatures across Rack Room A. Upon receiving the alerts, the incident was escalated internally at 18:33 CEST. Simultaneously, the on-call engineer departed for the datacenter to respond on-site. Following the escalation, additional team members joined the incident response. As an immediate mitigation measure, backup air conditioning units were activated at 18:34 CEST. Due to the elevated ambient temperatures, the firewall providing remote access to the datacenter infrastructure shut down automatically. At 18:39 CEST, the on-duty engineer arrived on-site and verified the availability of electrical power and the chilled water generation system. Both systems were operating normally and showed no indications of failure. At 18:43 CEST, the on-duty engineer identified an electrical fault affecting the cold-air circulation within the cold aisle of Rack Room A. Power to the free-cooling infrastructure was restored immediately. In addition, the chilled water supply temperature was reduced to increase cooling capacity and accelerate the recovery of room temperatures. We will use the findings from this incident to further strengthen the resilience of our infrastructure. The identified lessons learned will be incorporated into our engineering, monitoring, and operational procedures to reduce the likelihood and impact of similar incidents in the future.

Read the full incident report →

Started Jun 25, 2026, 09:15 AM UTC· resolved Jun 29, 2026, 10:06 AM UTC

1. monitoring Jun 25, 2026, 09:15 AM UTC

   We're currently closely monitoring the ongoing heatwave across Europe, with daytime temperatures exceeding 40°C. To ensure business continuity, we implemented several measures in advance: - The datacenter is cooled using a chilled water system, which has been verified to operate within the manufacturer's specified ambient temperature range - Adiabatic pre-cooling has been added to the chilled water system to reduce the temperature of incoming air before it reaches the mechanical cooling equipment - The datacenter is currently operating in recirculation mode. Outside-air free-cooling dampers are closed to maximize cooling efficiency during the heatwave. - Grid power quality is continuously monitored, and standby emergency generators are available to seamlessly take over the electrical load if required - Our datacenter on-call engineers are continuously monitoring operational metrics, with particular attention during peak temperature periods We do not expect operational instability following implementations made since 2025.

2. resolved Jun 29, 2026, 10:06 AM UTC

   We're closing the same, since the infrastructure dealt with the heatwave flawlessly. Outside temperatures were hitting 41°C past days.

Read the full incident report →

Started Jun 04, 2026, 08:43 AM UTC· resolved Jun 04, 2026, 08:43 AM UTC

1. resolved Jun 04, 2026, 08:43 AM UTC

   At 10:27 CEST, we experienced a power dip on the public power grid, causing a collapse of the supplied voltage. The UPS systems took over the load, keeping the servers supply at regular voltage levels.

Read the full incident report →

Started May 10, 2026, 09:14 AM UTC· resolved May 10, 2026, 02:03 PM UTC

1. investigating May 10, 2026, 09:14 AM UTC

   On-Site engineers investigating a current issue with aircon unit #2 appearing to be a electrical problem with the outside unit (condensor). We have temporarily increased supply temperature on other units to stabilize cold aisle temperature.

2. identified May 10, 2026, 10:26 AM UTC

   The unit is currently out of service due to a triggered security valve on the refrigeration circuit, likely causing impact to the refrigeration loop. We're cooling the datacenter with the working cooling units and have informed the maintenance company about the same.

3. monitoring May 10, 2026, 12:26 PM UTC

   On-Site engineers still monitoring the situation while the unit is out of service and being repaired.

4. resolved May 10, 2026, 02:03 PM UTC

   We will provide more details in a planned post-mortem. Temperatures throughout the data hall are stable since the incident happened in the morning, meaning redundancy works as intended. We observe a operational temperature range of about 25.4°C median across all cabinet cold aisle inlet sensors. On-Site engineers monitoring the situation until we have switched back thermal loads to free cooling later in the day. We will leave cold air supply increased, until repair operations are finished. For the upcoming week, we expect the pipe construction company to finish welding works on our new cold water loop network. The same supplies our in-house engineered cooling solution called deltaflow, offering advanced cooling output.

5. postmortem May 11, 2026, 12:46 PM UTC

   On 10th May 2026, 10:12 CEST, we experienced a failure of aircon unit #2 within RR.A. The issue was caused by a failure of the refrigeration loop due to a electrical issue with the outside condensor, causing blower fans to stop operating properly. The said issue caused increased pressure, which triggered a safety valve within the refrigeration loop, right after the compressor of the unit. Due to the triggered security valve, the unit was unable to cool properly anymore. Since the devices do not stop the inside EC fan, which is situated right after the vaporizer, the unit sucked warm air back into the cold aisle, causing a short temperature spike of up to 28°C. As of 10:18 CEST, on call duty received alarms about raising temperature within the cold aisle. Our first mitigation in such a case is the checking of cold aisle sensors and increase of supply temperature - either through other aircon units or through direct free cooling. We choose to increase the supply of cold air from direct free cooling due to current low outside temperatures. The system was now adding 20.000m³/h additional cold air to the datacenter. At the same time, we reduced temperatures of remaining aircon units. We were able to keep temperatures at a normal range of about ~25°C across the cold aisle of RR.A. On-Site personnel qualified to work on electrical circuits was called at 10:21 CEST and started investigating at 10:26 CEST the same at the outside unit, identifying a supply issue. We escalated the same further to the air conditioning company, who’s responsible for the stable operation of the same. The unit was repaired and cooling restarted. We are aware that technical defects can cause cooling abruptly to stop. For that reason, Tornado Datacenter operates multiple isolated air condition units, supplying cold air. Due to the increased electrical demands of colocation customers, we started to implement a n\+1 redundant cold water system. The same works in concert with our in-house engineered air-water heat-exchanger architecture, which is about to be taken live in the next week.

Read the full incident report →

Started Aug 13, 2025, 12:17 PM UTC· resolved Aug 13, 2025, 12:42 PM UTC

1. investigating Aug 13, 2025, 12:17 PM UTC

   Between 14:04:30 CEST and 14:07:30 CEST, we experienced a total blackout of the public power grid in Langen. The UPSes took over the load, we're currently checking the environment.

2. identified Aug 13, 2025, 12:29 PM UTC

   Public Grid is back since 14:07:30. Temperature increased by up to 28,3°C for 90 seconds until cold water generation returned operational, currently the temperature is down again to around 22°C.

3. resolved Aug 13, 2025, 12:42 PM UTC

   The UPS batteries are full again. Air Conditioners are operating normally. We're closing this incident. Onsite technicans have fully verified the infrastructure to be normally operational.

4. postmortem Aug 13, 2025, 12:56 PM UTC

   The last longer going power outage happened in August 2023. Today, whole city Langen was without power from 14:04 till 14:07 CEST. This affected everything which has no backup supply. Tornado Datacenter has diverse UPS for this case, one on A one on B Feed connected to central datacenter power distribution, which can change power sources from public grid \(default mode\) to generator \(backup mode\). Also a emergency generator is available to take over the loads in case of a longer going outage, providing sufficient spare fuel. Load transfer can happen after 20 seconds public grid outage, until that, the UPSes are taking over IT load. Generator fuel delivery is SLA guaranteed. Air Conditioning devices arent UPS protected, which is best practice in a modern datacenter environment. Not to mention the power draw of these, slowness of air temperature changes allow for restarts of cold air / water generation units, without breaching SLA or causing dangerous situations. A restart is caused whenever power is lost and/or transferred. During todays power outage, customers may have noticed a short spike in temperature, which was still below 30°C. Beside of the restart of air conditioning equipment, the infrastructure remained operational.

Read the full incident report →

Started Jul 03, 2025, 01:18 PM UTC· resolved Jul 03, 2025, 03:13 PM UTC

1. identified Jul 03, 2025, 01:18 PM UTC

   We have identified a power outage on L2 being related to a power grid issue. Servers continued being operational through UPS and Generator.

2. identified Jul 03, 2025, 01:54 PM UTC

   Dear Customers, the issue is still present and we have all cooling units except one running on generator. Temperature should have stabilized already.

3. monitoring Jul 03, 2025, 02:57 PM UTC

   Emergency Generator is still running and providing power since about 90 minutes.

4. resolved Jul 03, 2025, 03:13 PM UTC

   The issue is resolved. We still have load transfered on the emergency generator and transferring back in the next 30 minutes.

Read the full incident report →

Started Jul 02, 2025, 06:06 PM UTC· resolved Jul 17, 2025, 09:35 AM UTC

1. monitoring Jul 02, 2025, 06:06 PM UTC

   Dear Customers, we're currently experiencing increased cold aisle temperatures across the data-hall. The issue is caused by excessive outside air temperature, which was peaking at 40,5°C in Langen today, causing chiller inefficiency. We're in contact with chiller rental partners in order to increase capacity by three times of the current one by next week till end of September 2025. Unfortunately the excessive heat wave we're currently experiencing is causing us unexpected additional thermal load our air condition units are having issues dealing with. We're on-site in the datacenter and monitoring the situation to keep the environment stable as much as possible.

2. monitoring Jul 02, 2025, 07:56 PM UTC

   Dear Customers, we have activated direct freecooling, decreasing temperature spin and stabilizing aircon units. We'll keep this incident open to report about the additional cooling capacity implementation.

3. monitoring Jul 03, 2025, 11:57 AM UTC

   Planning of the implementation is in progress together with the landlord and rental company.

4. monitoring Jul 04, 2025, 09:48 AM UTC

   331kW Rental Chiller has been ordered and will be implemented as of Thursday 10th July 2025 together with two seperate inside units.

5. monitoring Jul 04, 2025, 03:29 PM UTC

   We're planning with an additional chiller unit sized equally as of Q1/2026 following implementation of 160kW additional cooling. The architecture will have two distinct water cycles running independently as well as powering Rack Room B in the future too. For now our top priority is to be prepared for the upcoming heat wave, which is forecasted > 13th July 2025, where temperatures will likely hit +40°C again. Cooling vendors are involved to carry out necessary works ASAP.

6. monitoring Jul 10, 2025, 09:56 AM UTC

   The MTA Aries chiller is delivered tomorrow morning, electrical connections are in place and three additional cold water aircon units are delivered today. We currently calculate with 42°C temperature peak end of July 2025.

7. monitoring Jul 11, 2025, 10:16 PM UTC

   The chiller has been delivered and we're working on it's go-live. We're planning with Monday, 14th July 2025, currently preparing the cold water network as well as electrical connections. Temperatures are stable since the incident occured.

8. monitoring Jul 14, 2025, 11:27 AM UTC

   Cooling Setup is in place, we're generating 14°C cold air (variabel down to 10°C) at ~200kW air con unit output. Dry waller is working to finish the build-up.

9. resolved Jul 17, 2025, 09:35 AM UTC

   Electrical installations and air guides are done. We have thoroughly tested the new MTA based setup at 10°C water input temperature, being able to cool down the datacenter onto a level, the existing aircon units would be no longer needed while maintaining stable ~21°C. Therefore we consider this incident as resolved on a permanent basis.

Read the full incident report →

Started Jun 25, 2025, 04:56 PM UTC· resolved Jun 25, 2025, 06:56 PM UTC

1. monitoring Jun 25, 2025, 04:56 PM UTC

   Dear customers, we're currently experiencing a increased cold aisle temperature due to a simultaneous incident on different air condition units, currently peaking at 27 instead of 25 degrees celsius according to our measurements. The failure has been already resolved and our staff is actively monitoring as well as investigating the issue. Due to the failure, temperature in cold aisle may have been temporary higher due to air condition units causing a thermal unexpected situation with increased supply air temperature.

2. resolved Jun 25, 2025, 06:56 PM UTC

   Dear Customers, we would like to report temperatures have decreased overall throughout the data hall. We're currently awaiting delivery for 30th June of equipment to increase cooling capacity Room A at 60%. Once the equipment arrives, we will make sure the same is installed directly. Thanks for your understanding.

Read the full incident report →

Started Apr 30, 2025, 01:15 PM UTC· resolved Apr 30, 2025, 06:48 PM UTC

1. monitoring Apr 30, 2025, 01:15 PM UTC

   We have identified a partial outage of the air conditioning at RR.A due to a misbehaving sensor, shutting down one unit. Remaining units and freecooling took over the load. Temperature increased minor, the unit has been reset and is actively cooling again.

2. monitoring Apr 30, 2025, 02:58 PM UTC

   The unit failed again and we were able to pinpoint the cause, working on a permanent solution.

3. resolved Apr 30, 2025, 06:48 PM UTC

   The issue has been resolved.

Read the full incident report →