2600Hz incident

Issues with upstream carrier Bandwidth.com / DTMF issues

Major Resolved View vendor source →

2600Hz experienced a major incident on September 27, 2021 affecting Telephony Services, lasting 17h 18m. The incident has been resolved; the full update timeline is below.

Started
Sep 27, 2021, 04:06 PM UTC
Resolved
Sep 28, 2021, 09:25 AM UTC
Duration
17h 18m
Detected by Pingoru
Sep 27, 2021, 04:06 PM UTC

Affected components

Telephony Services

Update timeline

  1. investigating Sep 27, 2021, 04:06 PM UTC

    Hi all, It seems Bandwidth is having more troubles today. Details available at https://status.bandwidth.com/. We are also recieveing numerious reports of DTMF issues on Bandwidth numbers. At this time all examples are on Bandwith numbers. If you have any non-bandwith.com examples, please call in with them. 2600Hz does not control any of this, we pick providers for things we can't control. We pick providers that we believe are good quality. Bandwidth.com always has been good quality. They're having a bad day today, though, and it's impacting us, and you, too. We trust their time is all over this and we'll be waiting it out, along with you, for resolution. Please note that we can NOT move your numbers to another provider for inbound - that's not a thing that can be done in VoIP or telecom in the US (phone numbers belong to one carrier only and the only way to change that is a port out, which takes days).

  2. monitoring Sep 27, 2021, 04:26 PM UTC

    2600Hz clients who are using their own hardware and data centers have also confirmed to us the Bandwidth numbers are experiencing DTMF problems. This would seem to further confirm our suspicions that this mornings issues are issues with Bandwidth service. Please monitor at https://status.bandwidth.com/

  3. monitoring Sep 27, 2021, 04:54 PM UTC

    We are seeing some improvements in DTMF issues and calls connecting properly. We are still waiting for an official update from Bandwidth

  4. monitoring Sep 27, 2021, 11:44 PM UTC

    Bandwidth.com is reporting all services are restored. We are continuing to monitor the situation and will update here if a significant change occurs.

  5. resolved Sep 28, 2021, 09:25 AM UTC

    It appears Bandwidth has resolved all items at this time