SignalFx US0 incident

Some metric datapoints not being accepted at ingest

Minor Resolved View vendor source →

SignalFx US0 experienced a minor incident on May 19, 2025 affecting Datapoint Ingest and Alerting, lasting 51m. The incident has been resolved; the full update timeline is below.

Started
May 19, 2025, 10:47 PM UTC
Resolved
May 19, 2025, 11:38 PM UTC
Duration
51m
Detected by Pingoru
May 19, 2025, 10:47 PM UTC

Affected components

Datapoint IngestAlerting

Update timeline

  1. identified May 19, 2025, 10:47 PM UTC

    We've identified as issue which is preventing approximately 0.1% of metric datapoints from being accepted at ingest, starting approximately at 3:15pm PT. This may result in false alerts and missing metric data in charts and detectors. We are currently implementing fixes to remediate this issue.

  2. monitoring May 19, 2025, 11:05 PM UTC

    We have implemented fixes and now observe less than 0.01% of metric datapoints not being accepted at ingest, trending down. We are continuing to monitor the fixes as they take effect.

  3. monitoring May 19, 2025, 11:27 PM UTC

    The fixes have taken effect as of 10 minutes ago, we are continuing to monitor for any further issues.

  4. resolved May 19, 2025, 11:38 PM UTC

    This incident has been resolved.