Spot AI incident

Google Cloud outage causing degraded service on Spot AI dashboard

Major Resolved View vendor source →

Spot AI experienced a major incident on February 15, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Feb 15, 2024, 09:28 PM UTC
Resolved
Feb 14, 2024, 03:48 PM UTC
Duration
Detected by Pingoru
Feb 15, 2024, 09:28 PM UTC

Update timeline

  1. resolved Feb 15, 2024, 09:28 PM UTC

    Appliances and cameras on the Spot dashboard appeared offline for at most 29 minutes from 10:48 AM PDT to 11:17 PDT on 2/14/2024. There was NO impact to video recording or access and no customer footage was affected by the outage. During this time, appliances and cameras appeared offline in the interface but all dashboard functionality was unaffected i.e. camera playback and video recording was working as usual. This was just a bug showing incorrect status of cameras. All customers could still access live and historical video. Customers may have also received alerts that their cameras were disconnected when they were still connected and streaming video. A reported outage from one of Google's services prevented our system from being able to process events related to appliance and camera uptime status. When Google resolved their outage, our systems caught up with the backlog of pending events, automatically resolving the issue without engineering intervention.