SolarWinds experienced a minor incident on November 30, 2023 affecting Query Sample Processing, lasting 5d 15h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 30, 2023, 07:41 PM UTC
We have detected some slowdowns in Query Sample processing, and are currently investigating the issue
- monitoring Dec 01, 2023, 05:36 PM UTC
Last night, our team identified the issue and applied a fix. Conditions have improved and we are currently monitoring for the query sample processing backlog to clear
- monitoring Dec 01, 2023, 06:30 PM UTC
We are continuing to monitor for any further issues.
- monitoring Dec 02, 2023, 06:33 PM UTC
While conditions have improved, the backlog has not yet cleared. We continue to monitor for the query sample processing backlog to clear.
- monitoring Dec 03, 2023, 06:58 PM UTC
The Query Sample Processing backlog has continued to improve but is not yet 100% finished. Many customer environments are current, with a few seeing about a 1-day lag.
- monitoring Dec 04, 2023, 04:50 PM UTC
The majority of samples are now being processed in real-time, and we continue to monitor the remaining backlog
- monitoring Dec 05, 2023, 02:55 PM UTC
A small number of environments are still affected, and we are expecting to clear the remaining backlog by tomorrow (Wednesday 6th)
- resolved Dec 06, 2023, 10:51 AM UTC
This incident has been resolved.