LMS365 incident
Admin Center degraded performance in North Europe
LMS365 experienced a minor incident on October 20, 2023 affecting Learn365 North Europe, lasting —. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- resolved Oct 20, 2023, 08:36 AM UTC
We would like to inform you that LMS365 admins in North Europe could experience delays (for more than 15 minutes) while performing different activities in Admin Center - for example, enrolling users, granting skills, removing users from the catalog, etc. This issue may have been observed in a timespan from 07:00 AM - 09:55 AM CET. We are happy to report that the issue is resolved now, and all the previous requests should have been completed. Thank you for your patience and please let us know if you see any further issues.
- postmortem Oct 23, 2023, 03:46 PM UTC
We sincerely regret any inconvenience caused by the recent service interruption. We understand the impact this had on your experience, and we genuinely apologize for the disruption. **Root Cause Analysis:** The degraded performance of LMS365 services occurred due to extensive usage of cloud API by one of our customers in the region. **Resolution:** We promptly addressed the issue through the following measures: * Isolated the customer database to reduce the impact on other customers. * Temporarily allocated additional resources to the affected tenant, speeding up their processes. **Remediation Steps:** * Strengthened our monitoring system to detect potential incidents before they impact our system. * Implemented code changes in the upcoming LMS365 October release to prevent similar issues. We appreciate your understanding and patience as we continuously enhance our services and work diligently to prevent any future disruptions.