Invoca incident

Google SIP Routing Issue - 9/12/24

Minor Resolved View vendor source →

Invoca experienced a minor incident on September 12, 2024 affecting Call Routing and Google Ads, lasting 16h 9m. The incident has been resolved; the full update timeline is below.

Started
Sep 12, 2024, 08:48 PM UTC
Resolved
Sep 13, 2024, 12:58 PM UTC
Duration
16h 9m
Detected by Pingoru
Sep 12, 2024, 08:48 PM UTC

Affected components

Call RoutingGoogle Ads

Update timeline

  1. identified Sep 12, 2024, 08:48 PM UTC

    We have identified an issue with Google's ability to successfully connect calls to Invoca over SIP. This primarily impacts Google Call Extension calls from connecting to Invoca tracking numbers. Google has identified the root cause and is working to resolve the issue. In the meantime, we are purposefully adjusting our routing methodology for all Google SIP calls to route over PSTN. This will ensure that calls made directly from Google ads continue to connect but will result in a loss of attribution data for any Google Call Extension calls.

  2. investigating Sep 12, 2024, 09:03 PM UTC

    To not disrupt any currently connected calls, we have elected to not swap Google SIP calls to route over to PSTN at this time. Currently, all calls routing over Google SIP are failing to connect to their destination.

  3. identified Sep 12, 2024, 10:00 PM UTC

    Continued impact of ~40% of all Google Inbound GCE Calls not connecting. Google has stated a fix is being implemented shortly, but no specific ETA at the moment.

  4. identified Sep 13, 2024, 01:03 AM UTC

    Google is continuing to resolve the issue. There have been recent improvements in successfully connecting Google Call Extension calls to their destinations, with 77% of their calls connecting over the last hour.

  5. monitoring Sep 13, 2024, 03:19 AM UTC

    We have seen no call failures since 9:24pm ET. We will continue to monitor this issue into tomorrow.

  6. resolved Sep 13, 2024, 12:58 PM UTC

    This incident has been resolved.