Datadog US1 incident

Host Tags, Service Checks, and Datadog Events Delayed Evaluation

Minor Resolved View vendor source →

Datadog US1 experienced a minor incident on September 29, 2025 affecting Metrics and Infra Monitoring and Monitors, lasting 1h 25m. The incident has been resolved; the full update timeline is below.

Started
Sep 29, 2025, 06:17 PM UTC
Resolved
Sep 29, 2025, 07:43 PM UTC
Duration
1h 25m
Detected by Pingoru
Sep 29, 2025, 06:17 PM UTC

Affected components

Metrics and Infra MonitoringMonitors

Update timeline

  1. investigating Sep 29, 2025, 06:17 PM UTC

    We’re currently investigating an issue causing delayed processing of host tag updates, Service Checks and Datadog Events, which may result in stale data appearing in the frontend. Our team is actively working to mitigate and fully resolve this. I’ll follow up as soon as the issue has been resolved. To prevent spurious alerts, we have temporarily disabled monitors based on this data.

  2. identified Sep 29, 2025, 06:20 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Sep 29, 2025, 07:36 PM UTC

    Service Check and Datadog Events monitor evaluation has recovered and data is up-to-date. Host tag updates are still recovering and stale host tags may appear in the frontend.

  4. resolved Sep 29, 2025, 07:43 PM UTC

    This incident has been resolved.