Beyond Identity experienced a major incident on December 5, 2022, lasting 1h 9m. The incident has been resolved; the full update timeline is below.
Update timeline
- investigating Dec 05, 2022, 08:26 PM UTC
We have identified issues with authentication. We are investigating the issue.
- investigating Dec 05, 2022, 08:29 PM UTC
We are continuing to investigate this issue.
- identified Dec 05, 2022, 08:42 PM UTC
We have identified a third-party service provider-related internet connection issue causing a partial outage. The engineering team is performing activities to recover.
- monitoring Dec 05, 2022, 09:03 PM UTC
The service has been recovered. The site reliability engineering team will continue to monitor.
- resolved Dec 05, 2022, 09:36 PM UTC
The incident has been resolved. The postmortem will be provided in a timely manner.
- postmortem Dec 07, 2022, 03:24 PM UTC
### Summary A third-party service provider's partial outage affected some customer networks accessing the cloud services. Our services were impacted from 12/5/2022, 14:00 CST, to 12/5/2022, 14:55 CST. The estimated partial outage lasted 55 minutes. The SRE team reacted promptly and identified that it was a third-party issue. The issue was resolved while preparing to fail over to another data center. ### Customer Impact During the partial outage, some customers were unable to authenticate. ### Mitigation and resolution While testing internally, some team members could authenticate, and some did not. Due to the intermittent failures, Beyond Identity investigated and assessed the impact to minimize the recovery impact on the user base. The SRE team started to prepare for failing over to another data center. By the time the preparations were complete, the service provider had restored the service.