SignalFx US1 had 45 outages in the last 2 years totaling 301h 54m of downtime — averaging 1.8 incidents per month.
There were 45 SignalFx US1 outages since May 22, 2025 totaling 301h 54m of downtime. Each is summarised below — incident details, duration, and resolution information.
From 9:08 PT – 9:12 PT we were unable to create some MTS datapoints. We were able to quickly resolve the issue and are monitoring our systems closely.
We are currently investigating the issue.
Metrics are now loading intermittently. We are working to resolve the issue.
We have identified the cause and fixed it. We are now closely monitoring the issue and ensuring there was no impact to ingestion.
This incident has been resolved.
We are investigating a reported issue indicating slowness and degraded performance within the US1 region. As a result, some customers may experience degraded UI performance when using charts, detectors, and running searches. Ingestion is not impacted.
We are still investigating the reported issue of slowness and degraded performance in the US1 region. Customers will continue experiencing degraded UI performance with charts, detectors, and searches. Please note that ingestion is not affected.
We continue investigating the reported issue of slowness and degraded performance in the US1 region. Our engineering team is taking appropriate actions to mitigate impact as quickly as possible. Customers will continue experiencing degraded UI performance with charts, detectors, and searches. Please note that ingestion is not affected.
We continue investigating the reported issue of slowness and degraded performance in the US1 region. Our engineering team is taking appropriate actions to mitigate impact as quickly as possible. Customers will continue experiencing degraded UI performance with charts, detectors, and searches. Please note that ingestion is not affected.
We are still investigating the reported issue of slowness and degraded performance in the US1 region. Customers will continue experiencing degraded UI performance with charts, detectors, and searches. Please note that ingestion is not affected.
We are still investigating the reported issue of slowness and degraded performance in the US1 region. Customers will continue experiencing degraded UI performance with charts, detectors, and searches. Please note that ingestion is not affected.
Service restoration is underway following the identification and mitigation of a high-consumption process. You may experience temporary issues while we fully restore functionality. Thank you for your patience.
The Observability services in US1 region have been fully restored and are now operational. We apologize for any inconvenience caused during the outage. Thank you for your patience.
We are investigating a partial outage of the Splunk Observability Cloud web application on the US1 realm. Customers may experience slowness or errors loading various UI components, including APM, Alerts, and Detectors. Trace data ingest is not impacted at this time. We will provide an update as soon as possible.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Chart and Dashboard Save operations are running into intermittent errors on UI.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Splunk Observability Cloud UI is either slow or down. Existing detectors are functional. There is no data loss. We are actively investigating the incident and will post updates as we have findings
We are continuing to investigate.
We are continuing to investigate this issue.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Splunk has identified a bug affecting all Unified Identity customers using Splunk Cloud version 9.3.2411.117 as their identity provider. Customers might be experiencing an inability to log in to Observability Cloud using the "Sign in via Splunk Cloud" workflow. The Splunk Cloud team is actively working on a solution, and the issue will be fully resolved once a patched version is released. The following workaround can be used by Customers using Unified Identity (without Centralized RBAC) until a patched version is released by the Splunk team 1. Customers using Unified Identity (without Centralized RBAC) can create a support case to have a set of users allow-listed for local login. 2. Once the users are allow-listed, the users will be able to login 3. After the patched version is released, the allowlist will be cleaned up There is no workaround for customers using Unified Identity (with Centralized RBAC) yet.
The issue has been identified and a fix is being implemented. The expected ETA is Oct 3 (Friday) by 5 PM Pacific
This incident has been resolved.
APM Tag spotlight and other APM service-centric views within the UI were unavailable between approximately 1pm PDT and 11 pm PDT for customers without Profiling entitlements due to a system error. Data ingest was not impacted. The issue has been resolved.
Customers may experience delays in seeing newly created metric time series as of 9/17/2025 11:00 AM PT. Datapoint ingest is not affected for existing time series. We are investigating and will provide an update shortly.
This incident is now resolved.
We are investigating an elevated rate of errors occurring while interacting with the Splunk APM API. Trace data ingest is not impacted.
We are continuing to investigate this issue.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Ingestion for aggregated Datapoints for Metrics are delayed. We are investigating and will provide an update every 15 mins.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Recent data may not have been available in search results for metrics and dimensions between 8:46am - 9:24am PDT. The issue has since been resolved.
An issue in the session replay processing pipeline is causing session replay data to be corrupted. Session replay data ingest is not impacted. We have identified the issue and are working on fixing it.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Datapoint ingest is affected and we are dropping datapoints. We are investigating and will provide an update every 15 mins.
Customers may experience intermittent timeout issues logging into app.us1.signalfx.com. We are investigating and will provide an update shortly. A small number of datapoints are not accepted at ingest, which may result in delays in some detectors.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Customers using unified identity may experience intermittent failures while logging into Splunk Observability cloud web interface. Datapoint Ingest is not affected. We are investigating and will provide an update shortly.
This incident has been resolved.
We are investigating a degradation in performance while using the Splunk APM Interface. Parts of the Splunk APM Troubleshooting experience like the service map, map breakdowns, Tag Spotlight and charts within Splunk APM may be impacted. Trace data ingest is not impacted.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Cloud metrics may be delayed up up 30 minutes in time window: 2:10 - 2:37 AM PST. There is no data loss, but data might be delayed.
A degradation of the ingest path for Organization metrics data points is causing data points to be dropped and lost. We are investigating the issue and will provide an update as soon as possible.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.