Zengenti Outage History

Type: Incident Duration: 33 minutes Affected Components: London data centre, Manchester data centre Mar 12, 14:16:00 GMT+0 - Investigating - We are currently investigating an issue affecting the availability of some customer websites. Mar 12, 14:48:40 GMT+0 - Resolved - This issue has now been resolved. We will send an incident report to customers in the next few days.

Type: Incident Duration: 17 minutes Feb 3, 14:55:59 GMT+0 - Investigating - We are currently investigating an issue impacting some client services and our helpdesk. Feb 3, 15:13:14 GMT+0 - Resolved - This incident has been resolved and we will issue an incident report to the affected clients in the next few days.

Type: Incident Duration: 47 minutes Affected Components: London data centre Jan 21, 10:35:06 GMT+0 - Investigating - We are investigating an issue where some client experiences issues logging into CMS environments using Entra/Azure AD Jan 21, 11:22:22 GMT+0 - Resolved - The issue was caused by a temporary connectivity problem, outside our control, within Microsoft Azure infrastructure that prevented Azure AD authentication traffic from reaching our CMS network. Resolution No changes or intervention were required on our side. Connectivity was restored, after which Azure AD authentication resumed normal operation. Preventative Actions We will continue to monitor Azure AD authentication traffic and login patterns. If similar issues occur in the future, we will investigate promptly and work with affected clients as required.

Type: Incident Duration: 1 hour and 16 minutes Nov 28, 10:21:30 GMT+0 - Investigating - We’re aware that some users are experiencing connectivity issues when accessing Zengenti-hosted sites. Initial investigation indicates this is related to wider internet connectivity instability, not a problem with Zengenti’s hosting environment. We’re continuing to monitor closely and will update you as soon as we have confirmed details. Nov 28, 10:35:40 GMT+0 - Monitoring - Monitoring systems are showing all systems are available once more. There appears to have been an issue with internet connectivity in the UK for a brief period which caused intermittent connectivity issues to some customer systems. We are continuing to monitor the situation and will take whatever action is necessary to ensure maximum reliability for all hosted systems. Nov 28, 11:37:45 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 11 minutes Affected Components: Manchester data centre Aug 29, 08:36:00 GMT+0 - Identified - We are aware of an issue in our Manchester datacenter that is affecting some hypervisors connecting to storage systems. We have identified the issue, and are fixing it. Aug 29, 08:47:11 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 7 days, 23 hours and 40 minutes Affected Components: Insytful, Development environments Aug 21, 08:55:19 GMT+0 - Identified - We have reduced redundancy to power feeds at our datacenter in Ludlow. There isn't currently any impact to running systems. We have an electrical engineer on route to fix the issue. Aug 21, 12:56:56 GMT+0 - Identified - Our engineer has identified a faulty component. Replacement parts have been expedited for delivery and installation tomorrow. There continues, partial power resilience in the HQ datacenter until resolved. Aug 29, 08:34:51 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 1 hour and 13 minutes Affected Components: Manchester data centre Jun 20, 12:54:33 GMT+0 - Investigating - We are currently investigating an intermittent issue affecting access to customer environments. Jun 20, 13:46:33 GMT+0 - Investigating - We are continuing to investigate the root cause of these issues, causing intermittent access to some customer environments. Jun 20, 14:07:57 GMT+0 - Resolved - The intermittent issue has now been resolved, and we will continue investigating the root cause. We will issue an incident report as soon as possible.

Type: Incident Duration: 3 minutes Affected Components: Help desk, London data centre, Manchester data centre May 28, 16:00:28 GMT+0 - Investigating - We are investigating an issue causing 503 errors across our infrastructure. May 28, 16:03:14 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 16 minutes Affected Components: Manchester data centre May 13, 12:25:53 GMT+0 - Investigating - We are currently investigating an issue with access to some customer environments. May 13, 12:41:49 GMT+0 - Resolved - The issue with the affected host has been resolved, and any impacted customer systems are back online.

Type: Incident Duration: 18 hours and 15 minutes Affected Components: Development environments Apr 2, 19:51:30 GMT+0 - Identified - We have identified an issue with a single storage device. This will only effect a couple of client systems partially, whilst maintenance work is performed to bring the reliance back to normal. Apr 3, 14:06:31 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 35 minutes Affected Components: London data centre, Manchester data centre, Help desk Mar 4, 16:04:38 GMT+0 - Resolved - This incident has been resolved. An incident report will follow. Mar 4, 15:29:51 GMT+0 - Investigating - We are aware of an issue affecting some customers, that is causing downtime to sites. We are investigating. Mar 4, 15:47:13 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result.

Type: Incident Duration: 37 minutes Affected Components: Manchester data centre Jan 21, 14:20:00 GMT+0 - Investigating - We are currently investigating an issue with our Manchester data centre. Traffic appears normal in our other data centres. Jan 21, 14:38:52 GMT+0 - Monitoring - It looks like we have identified an issue. We are taking corrective action and investigating the cause. Jan 21, 14:57:18 GMT+0 - Resolved - This incident has been resolved. A large spike of traffic caused failovers for some customers to DR environments, and will have caused some downtime for customers that don't have them. More information will follow in an incident report.

Type: Incident Duration: 1 hour and 22 minutes Affected Components: Development environments, Insytful Sep 9, 07:08:25 GMT+0 - Identified - We are continuing to work on a fix for this incident. Sep 9, 08:30:30 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Duration: 1 hour and 58 minutes Affected Components: Development environments Aug 28, 07:59:43 GMT+0 - Resolved - This incident has been resolved. Aug 28, 06:02:00 GMT+0 - Identified - We have identified the issue, and are now taking action to bring customer development environments back online.

Type: Incident Duration: 3 days, 14 hours and 38 minutes Affected Components: Development environments, Help desk, Insytful Aug 20, 12:59:22 GMT+0 - Investigating - We are investigating an issue affecting access to Development systems, Gitlab and Insytful Aug 20, 14:26:00 GMT+0 - Resolved - We have identified the root cause and are continuing to work on restoring the services. Gitlab is back up, and we are working to ensure that any services supporting Content Type and Entries are working as expected, as they can have a knock-on effect on the CMS production environments.

Type: Incident Duration: 22 minutes Affected Components: Insytful Aug 13, 08:42:29 GMT+0 - Resolved - This incident has been resolved. Aug 13, 08:20:32 GMT+0 - Investigating - We are currently working on bringing Insytful back to be fully operational