Red Canary incident

Increased number of failing system status checks

Resolved after 5 hours 39 minutes, affecting Web Portal, on June 10, 2025.

monitoring Jun 10, 2025, 08:36 PM UTC

We believe we have identified the root cause of the failing systems status checks. A fix has been implemented and we are monitoring the system to confirm it is returning to normal operations . Alert ingestion, alert timeliness, and response capabilities of the Red Canary platform are delayed. Telemetry ingestion and telemetry related detection are not affected.

Started
Jun 10, 2025, 07:55 PM UTC
Resolved
Jun 11, 2025, 01:35 AM UTC
Duration
5h 39m
Detected by Pingoru
Jun 10, 2025, 07:55 PM UTC

Affected components

Web Portal

Update timeline

  1. investigating Jun 10, 2025, 07:55 PM UTC

    We are currently investigating an increased number of failing system status checks across multiple customers.

  2. identified Jun 10, 2025, 08:03 PM UTC

    We believe we have identified the root cause of the failing system status checks and currently believe most of these failures are false positives and failed incorrectly. We are validating these findings and will implement a fix as appropriate. There is no impact to data ingestion, detection, or response capabilities of the Red Canary platform.

  3. monitoring Jun 10, 2025, 08:36 PM UTC

    We believe we have identified the root cause of the failing systems status checks. A fix has been implemented and we are monitoring the system to confirm it is returning to normal operations . Alert ingestion, alert timeliness, and response capabilities of the Red Canary platform are delayed. Telemetry ingestion and telemetry related detection are not affected.

  4. resolved Jun 11, 2025, 01:35 AM UTC

    This incident has been resolved.

Your product runs on more than Red Canary

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →