Kalix EMR experienced a critical incident on September 7, 2023, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Sep 07, 2023, 01:31 AM UTC
Starting at 11:37am EST there was a database connection issue that meant that all connections to the database were timing out, and this initial issue lasted until 11:55am EST. This had a secondary effect of increased timeouts between 12:01pm to 12:12pm EST. Unfortunately, the cause was due to our database system, which is separately managed by Azure, so we were not able to get any sort of ETAs as to when it would be fixed (before it had already recovered). We are still investigating the underlying reason why these timeouts occurred.