Splunk Observability Cloud US2 incident

Splunk RUM Monitoring MetricSets are being dropped

Major Resolved View vendor source →

Splunk Observability Cloud US2 experienced a major incident on January 24, 2025 affecting Splunk RUM Monitoring MetricSets, lasting 2h 12m. The incident has been resolved; the full update timeline is below.

Started
Jan 24, 2025, 09:58 PM UTC
Resolved
Jan 25, 2025, 12:10 AM UTC
Duration
2h 12m
Detected by Pingoru
Jan 24, 2025, 09:58 PM UTC

Affected components

Splunk RUM Monitoring MetricSets

Update timeline

  1. investigating Jan 24, 2025, 10:47 PM UTC

    A degradation of the ingest path for Splunk RUM is causing monitoring data to be dropped and lost. We are investigating the issue and will provide an update as soon as possible.

  2. investigating Jan 24, 2025, 10:56 PM UTC

    We are continuing to investigate this issue.

  3. investigating Jan 24, 2025, 11:09 PM UTC

    We are continuing to investigate this issue.

  4. investigating Jan 24, 2025, 11:20 PM UTC

    We are continuing to investigate this issue.

  5. identified Jan 24, 2025, 11:31 PM UTC

    The issue has been identified and a fix is being implemented.

  6. identified Jan 24, 2025, 11:39 PM UTC

    We are continuing to work on a fix for this issue.

  7. identified Jan 24, 2025, 11:54 PM UTC

    We are continuing to work on a fix for this issue.

  8. monitoring Jan 24, 2025, 11:58 PM UTC

    A fix has been implemented and we are monitoring the results.

  9. monitoring Jan 25, 2025, 12:09 AM UTC

    We are continuing to monitor for any further issues. No monitoring metric data is being lost at this time, but the most recent data may not be available.

  10. resolved Jan 25, 2025, 12:10 AM UTC

    This incident has been resolved.