Red Canary incident

Increased number of failing system status checks

Notice Resolved View vendor source →

Red Canary experienced a notice incident on June 10, 2025 affecting Web Portal, lasting 5h 39m. The incident has been resolved; the full update timeline is below.

Started
Jun 10, 2025, 07:55 PM UTC
Resolved
Jun 11, 2025, 01:35 AM UTC
Duration
5h 39m
Detected by Pingoru
Jun 10, 2025, 07:55 PM UTC

Affected components

Web Portal

Update timeline

  1. investigating Jun 10, 2025, 07:55 PM UTC

    We are currently investigating an increased number of failing system status checks across multiple customers.

  2. identified Jun 10, 2025, 08:03 PM UTC

    We believe we have identified the root cause of the failing system status checks and currently believe most of these failures are false positives and failed incorrectly. We are validating these findings and will implement a fix as appropriate. There is no impact to data ingestion, detection, or response capabilities of the Red Canary platform.

  3. monitoring Jun 10, 2025, 08:36 PM UTC

    We believe we have identified the root cause of the failing systems status checks. A fix has been implemented and we are monitoring the system to confirm it is returning to normal operations . Alert ingestion, alert timeliness, and response capabilities of the Red Canary platform are delayed. Telemetry ingestion and telemetry related detection are not affected.

  4. resolved Jun 11, 2025, 01:35 AM UTC

    This incident has been resolved.