SimpleVoIP experienced a minor incident on November 25, 2024 affecting Core Voice Services and SimpleVoIP Admin Portal, lasting 9h 48m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 25, 2024, 07:14 PM UTC
We are investigating reports of some calls not completing on our system as well as some slow response times through our Admin Portal. We will provide updates as soon as we have identified the cause and impact of this event.
- identified Nov 25, 2024, 07:41 PM UTC
We have identified some elevated server load causing significant post-dial delay on a subset of calls and failures on smaller subset. This also resulted in high response times from our Admin Portal. Our US-Central zone showed the highest incidence rate of these symptoms. As a temporary measure, we have routed some traffic away from US-Central to redistribute the load and alleviate the symptoms while we look for the underlying root cause. Since making that routing change, call traffic and web response times have returned to normal. We will continue to investigate and notify when we have confirmation of a fix from our Engineering team.
- monitoring Nov 25, 2024, 09:46 PM UTC
All traffic is back to normal levels and stable following the earlier routing change. Our Engineering team is still working to confirm the root cause.
- resolved Nov 26, 2024, 05:03 AM UTC
The temporary routing change has been reverted, and all traffic is stable. An RFO will be made available on this status page once the Engineering team wraps up their investigation and determines next steps.