Datadog Govcloud incident

Issues with Loading Dashboards

Major Resolved View vendor source →

Datadog Govcloud experienced a major incident on May 29, 2023 affecting Web Application, lasting 3h 7m. The incident has been resolved; the full update timeline is below.

Started
May 29, 2023, 08:14 AM UTC
Resolved
May 29, 2023, 11:22 AM UTC
Duration
3h 7m
Detected by Pingoru
May 29, 2023, 08:14 AM UTC

Affected components

Web Application

Update timeline

  1. investigating May 29, 2023, 08:14 AM UTC

    We are investigating an issue with loading dashboards. As a result, dashboard pages may return errors.

  2. identified May 29, 2023, 09:01 AM UTC

    We've identified an issue causing failures on a subset of pages on the web application, including Dashboards and Logs Explorer. Data ingestion and alerting are unaffected

  3. identified May 29, 2023, 10:12 AM UTC

    We've partially mitigated the issue, and Logs pages are now fully available. Errors loading Dashboards persist while we continue to work towards full resolution

  4. resolved May 29, 2023, 11:22 AM UTC

    This issue is now resolved. Our investigation revealed that only a small subset of customers were impacted by this incident.