Datadog EU incident

Delayed Metrics

Major Resolved View vendor source →

Datadog EU experienced a major incident on March 21, 2024 affecting Metrics and Infra Monitoring and Monitors, lasting 1h 45m. The incident has been resolved; the full update timeline is below.

Started
Mar 21, 2024, 02:20 PM UTC
Resolved
Mar 21, 2024, 04:05 PM UTC
Duration
1h 45m
Detected by Pingoru
Mar 21, 2024, 02:20 PM UTC

Affected components

Metrics and Infra MonitoringMonitors

Update timeline

  1. investigating Mar 21, 2024, 02:20 PM UTC

    We are investigating increased latency processing Metrics. As a result of this issue, some users may see delays or gaps for metrics on graphs. This is causing delays in Monitors Notifications, which began at 14:01 UTC.

  2. identified Mar 21, 2024, 02:47 PM UTC

    We have identified the underlying issue and are working on a fix. Please note that the Datadog Agent and Client Libraries will buffer data or retry to avoid gaps in data submission.

  3. monitoring Mar 21, 2024, 03:23 PM UTC

    We have deployed a fix and we are monitoring the results. We will provide another update once the issue is fully resolved.

  4. resolved Mar 21, 2024, 04:05 PM UTC

    This incident has been resolved.