Workspot incident

Azure Active Directory - experience authentication issues when attempting to access Azure, Dynamics 365, and/or MIcrosoft 365.

Major Resolved View vendor source →

Workspot experienced a major incident on December 16, 2021 affecting Workspot Control, lasting 12h 8m. The incident has been resolved; the full update timeline is below.

Started
Dec 16, 2021, 03:08 AM UTC
Resolved
Dec 16, 2021, 03:17 PM UTC
Duration
12h 8m
Detected by Pingoru
Dec 16, 2021, 03:08 AM UTC

Affected components

Workspot Control

Update timeline

  1. identified Dec 16, 2021, 03:08 AM UTC

    Impact Statement: Starting at 12:11 UTC on Dec 16 2021, customers using Azure Active Directory or Microsoft account may experience authentication issues when attempting to access Azure, Dynamics 365, and/or Microsoft 365. Current Status: Microsoft is aware of this issue and is actively investigating. The next update will be provided in 60 minutes, or as events warrant. Please refer to https://status.azure.com/en-us/status. This message was last updated at 02:30 UTC on 16 December 2021. Please note the time in Microsoft's notification above might be incorrect.

  2. monitoring Dec 16, 2021, 04:28 AM UTC

    Microsoft performed a failover for authentication services to redundant, healthy infrastructure to mitigate the issue. Preliminary root Cause: A shared component of the Microsoft account (MSA) and Azure AD sign-in services stopped responding when a combination of a configuration error and a routine update caused multiple redundant endpoints to become unreachable. This caused sign-in failures in Microsoft services for both Microsoft personal accounts and Azure AD accounts. Next steps: Microsoft is analyzing performance data and trends on the affected systems to ensure that mitigation remains in full effect. A Post Incident Report will be published within the next 48-72 hours.

  3. monitoring Dec 16, 2021, 05:50 AM UTC

    We are continuing to monitor for any further issues.

  4. resolved Dec 16, 2021, 03:17 PM UTC

    Summary of impact: Between 00:11 UTC and 02:25 UTC on 16 Dec 2021, customers may have experienced issues signing into Azure services. Preliminary root Cause: A shared component of the Microsoft account (MSA) and Azure AD sign-in services stopped responding when a combination of a configuration error and a routine update caused multiple redundant endpoints to become unreachable. This caused sign-in failures in Microsoft services for both Microsoft personal accounts and Azure AD accounts. Mitigation: Microsoft performed a failover for authentication services to redundant, healthy infrastructure. Microsoft analyzes performance data and trends on the affected systems to ensure that mitigation remains in full effect. A Post Incident Report will be published within the next 48-72 hours. Please refer https://status.azure.com/en-us/status/history/ for the report.