SimpleVoIP experienced a critical incident on October 28, 2022 affecting Core Voice Services, lasting 8h 39m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 28, 2022, 09:41 PM UTC
We are investigating reports of some calls not completing on our system. We will provide updates as soon as we have identified the cause and impact of this event.
- identified Oct 28, 2022, 09:49 PM UTC
The current call failures are isolated to our US-Central cluster. We are making a routing change to divert traffic away from that cluster until we are able to identify and resolve the underlying issue. We should have another update shortly.
- monitoring Oct 28, 2022, 10:00 PM UTC
Our monitoring systems show that calls are completing normally following the routing change. Our engineers are still working on the underlying issue on US-Central, but we do not believe it is causing any impact at this time. If your users are experiencing any issues, please let our support team know. We will continue to monitor the status of the US-East and US-West servers extra closely as they handle the additional call volume. Informational updates will be posted on this page as we determine the action required to restore US-Central to active service. We will spare you the email notifications for those updates unless any additional service impact is discovered.
- resolved Oct 29, 2022, 06:20 AM UTC
Our engineers have determined it safe to restore traffic to US-Central, so the emergency routing change has been reverted. All traffic is now flowing over normal routes. We have detected no issues with inbound or outbound calls, and this incident is considered resolved.