Kalix EMR experienced a major incident on February 12, 2021 affecting Kalix Platform and Telehealth and 1 more component, lasting 1d 2h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 12, 2021, 12:39 AM UTC
We are currently investigating the cause of the issue to be able to find a fix
- identified Feb 12, 2021, 12:44 AM UTC
We have found the underlying problem to be that our managed database is timing out to requests. This seems to be an issue with the underlying provider and we are working with them to get this fixed.
- identified Feb 12, 2021, 01:20 AM UTC
There has been an update from our provider (Azure). They are currently investigating the issue. They are showing tracking for this issue on their status page: https://status.azure.com/en-us/status The service that is affected is 'Azure Cosmos DB'.
- identified Feb 12, 2021, 01:41 AM UTC
There has been an update from Azure - they have assigned engineers to the issue. You can continue to see status updates from Azure on their status page: https://status.azure.com/en-us/status
- identified Feb 12, 2021, 02:44 AM UTC
The database was temporarily live for a few minutes, but is offline again. We are continue to monitor the situation and will update once we can see that the databases are online and processing requests correctly.
- monitoring Feb 12, 2021, 04:53 AM UTC
The database has been consistently live for over 15 minutes, so we think the issue has been fixed. We are continuing to monitor and will update here if there are any issues. Kalix is functioning normally again.
- resolved Feb 13, 2021, 03:15 AM UTC
This incident has been resolved.