BluIP incident

Incident: Intermittent Google Cloud Outage Impacting AIVA Console and Reporting Performance

Resolved after 20 hours 22 minutes, affecting WebRTC Portal Login and Reporting, on June 12, 2025.

resolved Jun 13, 2025, 03:31 PM UTC

This incident has been resolved. The intermittent performance issues affecting the AIVA Console were caused by an upstream service disruption within Google Cloud. All affected functionality—including queue statistics, agent status updates, reporting, and authentication—has returned to normal. Voice services remained unaffected throughout the incident. We will continue monitoring for any residual effects, but no further impact is expected. For reference, you can review the incident on Google’s status page here: https://status.cloud.google.com/ Thank you for your patience and understanding.

Started
Jun 12, 2025, 07:09 PM UTC
Resolved
Jun 13, 2025, 03:31 PM UTC
Duration
20h 22m
Detected by Pingoru
Jun 12, 2025, 07:09 PM UTC

Affected components

WebRTC Portal LoginReporting

Update timeline

  1. identified Jun 12, 2025, 07:09 PM UTC

    Start Time: 10:53AM PST Impact: Minor - Intermittent performance issues affecting a subset of users We are currently observing intermittent performance issues within the AIVA Console platform due to an ongoing incident with Google Cloud. Customers who are already logged into the AIVA Console may experience delays with queue statistics updates and real-time synchronization features such as agent presence, call status, and reporting data. **** Importantly, voice calling and handling remains unaffected.*** While Google’s status page (https://status.cloud.google.com/) currently reports that authentication services are not impacted, we are seeing isolated authentication-related issues when users attempt to log in. If you encounter errors during login or see degraded performance, refreshing the console or attempting to log in again may help establish a successful session. We are monitoring the situation closely and will provide updates as more information becomes available or the incident is resolved. Thank you for your patience and understanding.

  2. monitoring Jun 12, 2025, 10:27 PM UTC

    The intermittent issues related to Google Cloud now appear to be resolved. AIVA Console performance, including queue statistics, real-time sync features, and authentication, has returned to normal. We are continuing to monitor to ensure full stability. If you continue to experience any issues, please try refreshing the console or contact BluIP support. We’ll provide a final update once the incident is fully closed. Thank you for your continued patience.

  3. resolved Jun 13, 2025, 03:31 PM UTC

    This incident has been resolved. The intermittent performance issues affecting the AIVA Console were caused by an upstream service disruption within Google Cloud. All affected functionality—including queue statistics, agent status updates, reporting, and authentication—has returned to normal. Voice services remained unaffected throughout the incident. We will continue monitoring for any residual effects, but no further impact is expected. For reference, you can review the incident on Google’s status page here: https://status.cloud.google.com/ Thank you for your patience and understanding.

Your product runs on more than BluIP

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →