DG Technology experienced a minor incident on May 7, 2015, lasting 11h 8m. The incident has been resolved; the full update timeline is below.
Update timeline
- identified May 07, 2015, 10:29 AM UTC
Our two datacentres based within the Kent Science Park are currently running on generators due to a loss of grid power in the area, caused by breakers on the high voltage (HV) network tripping. UK Power Networks are already aware of the issue and have engineers working to establish the location of the fault. Once established the faulty elements will be isolated and the network re-energised. There has been no outage to customer services as both facilities have automatically switched to backup generator power feeds, and no outage is expected, however services should be considered "at risk". Estimated restoration of grid power is 13:30, and we will update this message as we receive more information.
- identified May 07, 2015, 11:39 AM UTC
UK Power Network engineers have arrived at the location of the fault (Sittingbourne West HV substation) and understand what needs to be replaced to restore grid supply to the area. Both datacentres continue to run from generator power, without interruption to service. Estimated restoration of grid power remains as 13:30.
- identified May 07, 2015, 01:51 PM UTC
UK Power Networks advise that work is ongoing to restore service, and that due to the complex nature of the issue the estimated restoration time is now 16:00. Both datacentres continue to run from generator power, without interruption to service.
- identified May 07, 2015, 04:18 PM UTC
We have been advised that a damaged HV cable has now been identified as part of this fault. Engineers are working to repair the cable, test it and restore service. Both datacentres continue to run on generator power, and are being closely monitored by our onsite teams, as well as our Network Operations Centre (NOC) in Hampshire. The new estimated time for resolution is 20:00, and we will update this message as we receive more information.
- identified May 07, 2015, 08:18 PM UTC
We have seen grid power to part of the site restored, including one of the datacentres. We anticipate power will continue to be restored in stages, and will update this status next when power has been fully restored to both facilities.
- monitoring May 07, 2015, 08:52 PM UTC
Grid mains power was restored to the entire campus by 21:30. The datacentres have remained on generator power whilst we have been monitoring the mains feed to ensure it's stable, and we intend to come off generators at 22:00 assuming stability has remained.
- resolved May 07, 2015, 09:37 PM UTC
We have successfully completed a controlled switch over from generator to grid power at both datacentres. There was no impact to hosted services during this 11 hour loss of grid power, caused by a damaged HV cable.