CallTrackingMetrics experienced a major incident on September 11, 2024 affecting Application Availability, lasting 12h 5m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 11, 2024, 12:50 AM UTC
We are currently investigating intermittent reports of customers having difficulty accessing our softphone. This is not affecting all regions. We will report back shortly.
- investigating Sep 11, 2024, 01:22 AM UTC
We are currently investigating intermittent reports of customers having difficulty accessing our softphone. Some clients are able to authenticate but others are being affected by an issue with our upstream voice provider. We are actively working with them now
- identified Sep 11, 2024, 01:38 AM UTC
We have identified the issue is related to device authentication from our upstream voice provider. It is only affecting softphone and chat connections. We have found that the issue is intermittent and with jwt access tokens and that that refreshing and retrying can get through. We are actively working on a resolution with our provider.
- identified Sep 11, 2024, 02:00 AM UTC
Our upstream provider has identified the issue and is working on a fix. We are seeing restoration.
- monitoring Sep 11, 2024, 02:13 AM UTC
We have been working with our upstream provider and they have deployed a resolution to the issue. The issue is being tracked here by Twilio: https://status.twilio.com/ We will continue to post updates as we monitor the recovery.
- resolved Sep 11, 2024, 12:56 PM UTC
This incident has been resolved.