SolarWinds Observability incident

Delayed Data Ingestion [NA-01]

Minor Resolved View vendor source →

SolarWinds Observability experienced a minor incident on June 24, 2025 affecting Alerting and APM and 1 more component, lasting 6h 43m. The incident has been resolved; the full update timeline is below.

Started
Jun 24, 2025, 04:25 PM UTC
Resolved
Jun 24, 2025, 11:08 PM UTC
Duration
6h 43m
Detected by Pingoru
Jun 24, 2025, 04:25 PM UTC

Affected components

AlertingAPMDEMRUMLogsDatabase ObservabilityNetwork ObservabilityKubernetes ObservabilityInfrastructure Observability

Update timeline

  1. investigating Jun 24, 2025, 04:25 PM UTC

    We’re currently investigating delay in Logs, Metrics and Traces data ingestion. As a result, New data may not appear in the UI, alerts may be delayed, and some dashboards could show missing or outdated values. We’ll provide another update within the hour.

  2. identified Jun 24, 2025, 05:24 PM UTC

    We’ve identified the cause of the delay in Logs, Metrics and Traces data ingestion and are working on a fix. New data may not appear in the UI, alerts could be delayed, and some dashboards might show missing or outdated values. We’ll provide an update within the hour.

  3. identified Jun 24, 2025, 06:21 PM UTC

    We’ve identified the cause of the delay in Logs, Metrics and Traces data ingestion and are working on a fix. New data may not appear in the UI, alerts could be delayed, and some dashboards might show missing or outdated values. We’ll provide an update within the hour.

  4. identified Jun 24, 2025, 07:19 PM UTC

    We’ve identified the cause of the delay in Logs, Metrics and Traces data ingestion and are working on a fix. New data may not appear in the UI, alerts could be delayed, and some dashboards might show missing or outdated values. We’ll provide an update within the hour.

  5. identified Jun 24, 2025, 08:25 PM UTC

    We’ve identified the cause of the delay in Logs, Metrics and Traces data ingestion and are working on a fix. New data may not appear in the UI, alerts could be delayed, and some dashboards might show missing or outdated values. We’ll provide an update within the hour.

  6. identified Jun 24, 2025, 09:26 PM UTC

    We’ve identified the cause of the delay in Logs, Metrics and Traces data ingestion and are working on a fix. New data may not appear in the UI, alerts could be delayed, and some dashboards might show missing or outdated values. We’ll provide an update within the hour.

  7. monitoring Jun 24, 2025, 10:33 PM UTC

    A fix for the Logs, Metrics, Traces data ingestion delay has been deployed, and we’re actively monitoring to ensure full recovery. Some new data may still be missing from the UI, alerts may be delayed, and dashboards could reflect outdated information. We’ll share another update within the hour.

  8. resolved Jun 24, 2025, 11:08 PM UTC

    The ingestion delay issue has been resolved. New data is now processing normally, and alerts and dashboards should reflect up-to-date information.