New Relic incident

Degraded Query Functionality in the US Region

Notice Resolved View vendor source →

New Relic experienced a notice incident on March 8, 2025 affecting APM : US and APM Agent : US and 1 more component, lasting 1h 5m. The incident has been resolved; the full update timeline is below.

Started
Mar 08, 2025, 09:09 PM UTC
Resolved
Mar 08, 2025, 10:15 PM UTC
Duration
1h 5m
Detected by Pingoru
Mar 08, 2025, 09:09 PM UTC

Affected components

APM : USAPM Agent : USAlerts : USAPM : USBrowser : USBrowser Agent : USInfrastructure : USEvent API : USAuto-Telemetry with Pixie : USLogs : US

Update timeline

  1. investigating Mar 08, 2025, 09:09 PM UTC

    We are investigating a service interruption impacting data from query responses which may be affecting some customers in the US region. No data drops have been observed at this time and no further actions are required by customers as we work to resolve this.

  2. investigating Mar 08, 2025, 09:20 PM UTC

    We have determined the service interruption has not impacted ingest or alerts but has to do with serving live queries. We are continuing to investigate and thank you for your patience while we work through this issue.

  3. investigating Mar 08, 2025, 09:46 PM UTC

    We are continuing to investigate this issue.

  4. monitoring Mar 08, 2025, 10:05 PM UTC

    The incident is now in recovery with data ingest and alerting unaffected.

  5. resolved Mar 08, 2025, 10:15 PM UTC

    We resolved this service interruption and impacted services have returned to normal operation. Between 08:27 UTC and 09:37 UTC on March 8th, some customers in the US region may have experienced missing data from live edge NRDB queries. Data ingest and alerts were not affected.