TelNet Worldwide incident

Partial inbound and outbound calls issues.

Minor Resolved View vendor source →

TelNet Worldwide experienced a minor incident on September 27, 2021, lasting 9h 13m. The incident has been resolved; the full update timeline is below.

Started
Sep 27, 2021, 02:30 PM UTC
Resolved
Sep 27, 2021, 11:43 PM UTC
Duration
9h 13m
Detected by Pingoru
Sep 27, 2021, 02:30 PM UTC

Update timeline

  1. investigating Sep 27, 2021, 06:17 PM UTC

    We are currently aware of ongoing issues affecting inbound and outbound calls to certain telephone number ranges. Our NOC team is investigating the issue with priority.

  2. investigating Sep 27, 2021, 06:17 PM UTC

    We are continuing to investigate this issue.

  3. investigating Sep 27, 2021, 06:18 PM UTC

    We are continuing to investigate this issue.

  4. investigating Sep 27, 2021, 06:25 PM UTC

    We are continuing to investigate this issue.

  5. identified Sep 27, 2021, 06:27 PM UTC

    We have identified the problem and currently working with one of our Carrier Partners to recover service.

  6. identified Sep 27, 2021, 06:47 PM UTC

    A portion of IPFone customers may be experiencing intermittent inbound and outbound calling issues, including to emergency services due to an underlying carrier. IPFone NOC is continuing to work with the underlying carrier to resolve this issue and will provide updates as they become available.

  7. identified Sep 27, 2021, 07:07 PM UTC

    A portion of IPFone customers may be experiencing inbound call connection delays and dead air. We are working with the underlying carrier to resolve this issue ASAP. IPFone NOC is continuing to work with the underlying carrier to resolve this issue and will provide updates as they become available.

  8. investigating Sep 27, 2021, 07:54 PM UTC

    We continue to work with our PSTN partner, Bandwidth.com, who has acknowledged that the cause of degradation is a Distributed Denial of Service (DDoS) attack that is affecting all of their service provider interconnects. They are working diligently to contain the attack, but are unable to say more at this time. We will continue to provide updates as they become available

  9. investigating Sep 27, 2021, 08:03 PM UTC

    We continue to work with our PSTN partner, Bandwidth.com, who has acknowledged that the cause of degradation is a Distributed Denial of Service (DDoS) attack that is affecting all of their service provider interconnects. They are working diligently to contain the attack, but are unable to say more at this time. We will continue to provide updates as they become available.

  10. investigating Sep 27, 2021, 08:32 PM UTC

    Dear Customer, Several customers are still currently experiencing issues with incoming phone calls due to a nationwide outage impacting all major VoIP carriers. We continue to work with our PSTN provider affecting their service provider interconnects. We will continue to provide updates as they become available. Sorry for the inconvenience.

  11. investigating Sep 27, 2021, 08:32 PM UTC

    We are continuing to investigate this issue.

  12. identified Sep 27, 2021, 10:18 PM UTC

    We continue to work with our PSTN partner, Bandwidth.com, At this moment, we observed Toll-Free services and outbound calling operating as designed. They are working diligently and we will continue to provide updates as they become available.

  13. resolved Sep 27, 2021, 11:43 PM UTC

    Dear customer, At this moment, we observed inbound calling, outbound calling and Toll-Free services operating as designed. Full voice services are back and working. We will continue monitoring the services and the vendor services and we will provide any updates if necessary. In the next 24/48 hours we will provide you with a RFO (reason for outage) to explain what happened and what actions are taken.