2600Hz incident

Increased Reports Of Call Completion Issues

Major Resolved View vendor source →

2600Hz experienced a major incident on November 2, 2022 affecting Telephony Services, lasting 3h 41m. The incident has been resolved; the full update timeline is below.

Started
Nov 02, 2022, 07:20 PM UTC
Resolved
Nov 02, 2022, 11:02 PM UTC
Duration
3h 41m
Detected by Pingoru
Nov 02, 2022, 07:20 PM UTC

Affected components

Telephony Services

Update timeline

  1. investigating Nov 02, 2022, 07:20 PM UTC

    We've seen a spike of reports from clients about call completion issues. At this time most reports seem to be coming from the EWR zone. We are investigating the issue now

  2. investigating Nov 02, 2022, 09:34 PM UTC

    We have removed the EWR servers from Kamillio rotation. This should force traffic to unaffected zones until we can resolve the root cause of this issue. Phones that have proper SRV/NAPTR records should resume service

  3. resolved Nov 02, 2022, 11:02 PM UTC

    We have stabilized EWR and resuming service in this zone