Keepit experienced a minor incident on February 29, 2024 affecting User Interface and API, lasting 11h 3m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 29, 2024, 10:43 PM UTC
Currently, the DK-CO region is experiencing UI instabilities; especially larger downloads are affected
- identified Feb 29, 2024, 11:07 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Feb 29, 2024, 11:11 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Mar 01, 2024, 09:47 AM UTC
This incident has been resolved.
- postmortem Mar 15, 2024, 01:45 PM UTC
At 18:53 UTC February 29 2024 the Keepit installation at DK-CO available on the address [https://dk-co.keepit.com/](https://dk-co.keepit.com/) commenced a series of unscheduled service restarts. The dual-active setup of the Keepit stack ensured availability throughout the incident, however the stack was not able to facilitate longer running downloads. An implementation error was identified in a central Keepit component and functionality triggering this particular error was disabled and at 23:08 UTC the service degradation ended. At no point was the ability to perform backups impacted and at no point was customer data at risk. The root cause of the issue has subsequently been fixed and released.