SignalFx US1 incident

Splunk APM Monitoring, Troubleshooting MetricSets and Trace Data are Delayed

Major Resolved View vendor source →

SignalFx US1 experienced a major incident on May 1, 2025 affecting Splunk APM Ingest and Splunk APM Monitoring MetricSets and 1 more component, lasting 56m. The incident has been resolved; the full update timeline is below.

Started
May 01, 2025, 09:52 PM UTC
Resolved
May 01, 2025, 10:49 PM UTC
Duration
56m
Detected by Pingoru
May 01, 2025, 09:52 PM UTC

Affected components

Splunk APM IngestSplunk APM Monitoring MetricSetsSplunk APM Troubleshooting MetricSetsSplunk APM Trace DataSplunk APM Tag Spotlight

Update timeline

  1. investigating May 01, 2025, 10:22 PM UTC

    A degradation in the performance of a key backend component of Splunk APM is causing both Troubleshooting, Monitoring MetricSets and Trace Data to be delayed by more than five minutes. No data is being dropped at this time but data for the APM Troubleshooting page, Tag Spotlight experience, Trace Analyzer and other APM pages, as well as metrics created from traces and APM detectors are all delayed.

  2. monitoring May 01, 2025, 10:28 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved May 01, 2025, 10:49 PM UTC

    This incident has been resolved.