IPFone experienced a major incident on September 28, 2021, lasting 21h 30m. The incident has been resolved; the full update timeline is below.
Update timeline
- investigating Sep 28, 2021, 02:03 PM UTC
As of 9:51 EDT we are observing degraded calling with Bandwidth, and have received customer reports that correlate with this. We will continue to pursue with the vendor for resolution.
- investigating Sep 28, 2021, 02:18 PM UTC
Multiple customers are still currently experiencing issues with incoming phone calls due to a nationwide outage impacting all major VoIP carriers. We continue to work with our PSTN provider affecting their service provider interconnects. We will continue to provide updates as they become available.
- investigating Sep 28, 2021, 04:33 PM UTC
A small portion of IPFone customers may continue experiencing inbound call connection delays and dead air. We are working with the underlying carrier to resolve this issue. Will provide updates as they become available.
- identified Sep 28, 2021, 05:33 PM UTC
We continue to work with Bandwidth on the intermittent inbound calling issues. Customers may experience drop calls or one-way audio issues. Bandwidth.com has acknowledged to IPFone they have been the victim of a Distributed Denial of Service (DDoS) attack and are currently working to mitigate the impact. This attack has been published by various media outlets as Bandwidth is a significant provider of telecommunications services. Bandwidth’s engineers are responding in real-time and their management has committed to keeping IPFone informed of the latest developments
- identified Sep 28, 2021, 05:59 PM UTC
Our underlying carrier is reporting that they are continue to have some intermittent issues, but largely improved and resolved. They continue to fortify mitigation measures until services are fully restored and stable.
- identified Sep 28, 2021, 09:49 PM UTC
Our underlying carrier, bandwidth.com, is reporting that they are continue to have some intermittent issues, but largely improved and resolved. They continue to fortify mitigation measures until services are fully restored and stable. We will continue to provide updates as they become available.
- resolved Sep 29, 2021, 11:33 AM UTC
Our underlying carrier, bandwidth.com, is reporting network stability, we consider this incident resolved. Teams will continue to monitor our network. Should additional updates be needed, they will be posted here.