SimpleVoIP experienced a minor incident on January 3, 2025 affecting Core Voice Services, lasting 1d 7h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jan 03, 2025, 12:39 PM UTC
A systems issue overnight resulted in many phones losing registration to our servers. Most phones will periodically attempt to re-register and come up on their own. A power cycle will accelerate that process if needed. Some phones are still impacted, and we are working to restore them as quickly as possible.
- identified Jan 03, 2025, 01:52 PM UTC
Almost all phones have had their configs restored at this point. Roughly 40% of phones are still offline, but will reconnect when they next pull their config from SimpleVoIP, whether via their automated config fetch or a manual power cycle. If any locations are having trouble restoring their phones, please reach out to our support team.
- identified Jan 03, 2025, 02:54 PM UTC
We are still working to restore the configs for a few hundred phones to get them up and running again. We expect to have them fully restored within the next hour.
- monitoring Jan 03, 2025, 03:21 PM UTC
All phone configs are restored at this time. Any phones still not registered will likely need a reboot to force a config request before they will come back online.
- resolved Jan 04, 2025, 08:06 PM UTC
All but a few phones have been back up and registered since yesterday morning. If any phones do not come back up with a manual power cycle, please call into our Support team.