Searchspring incident

Search API Down

Major Resolved View vendor source →

Searchspring experienced a major incident on October 20, 2025 affecting Search and Indexing and 1 more component, lasting 1d 9h. The incident has been resolved; the full update timeline is below.

Started
Oct 20, 2025, 06:10 PM UTC
Resolved
Oct 22, 2025, 03:54 AM UTC
Duration
1d 9h
Detected by Pingoru
Oct 20, 2025, 06:10 PM UTC

Affected components

SearchIndexingAutocompleteSMC ( Searchspring Management Console )

Update timeline

  1. identified Oct 20, 2025, 03:12 PM UTC

    We have identified an incident that our Search API is currently down, post AWS outage. The team is currently investigating, and identified a potential problem.

  2. identified Oct 20, 2025, 03:41 PM UTC

    We have isolated the problem to be fully related to AWS outages. Indexing, Search functionality and also management console are impacted.

  3. identified Oct 20, 2025, 04:28 PM UTC

    In order to protect our system and make sure we get services back as quickly as possible once AWS outage is recovered, we have to put our Management Console into maintenance mode. Users are blocked from making any changes as of now. Thanks for your understanding during this difficult time!

  4. identified Oct 20, 2025, 04:37 PM UTC

    Updating impact: we have confirmed the impact is confined to the same region (us-east) as AWS has identified. Traffic on us-west and other regions are still fine.

  5. identified Oct 20, 2025, 06:05 PM UTC

    Part of the services are brought back to normal level. We are still waiting on another AWS-dependent vendor to come back to normal before we take Management Console back)

  6. identified Oct 20, 2025, 06:10 PM UTC

    Search API is now back to normal level - we are monitoring

  7. monitoring Oct 20, 2025, 06:10 PM UTC

    We are monitoring the results for Search, Autocomplete, while waiting for AWS fix to propagate

  8. monitoring Oct 20, 2025, 08:30 PM UTC

    We continue to observe some instability on AWS side as well as our vendor who's hosted on AWS. Team is still working on restoring the services, while monitoring the restoring effort of AWS.

  9. monitoring Oct 20, 2025, 09:24 PM UTC

    Search and Autocomplete is being recovered. Team is working on a fix to bring Indexing and Management back.

  10. monitoring Oct 20, 2025, 10:08 PM UTC

    Search API/Autocomplete API are fully recovered. Engineering team is still working on fixes to bring Indexing service back.

  11. monitoring Oct 20, 2025, 10:23 PM UTC

    Our engineering team has taken Management Console out of maintenance mode. We are still working on bringing indexing service back.

  12. monitoring Oct 20, 2025, 10:30 PM UTC

    Management Console is back to Operational

  13. monitoring Oct 20, 2025, 10:59 PM UTC

    Reporting in SMC is currently experiencing issues due to the same ongoing AWS outage. We are working on bringing it back.

  14. monitoring Oct 20, 2025, 11:32 PM UTC

    We are seeing Search/Autocomplete fully recovered. SMC is mostly recovered, experiencing intermittent issue with reporting (not being able to render reports properly). Our Engineering team is still actively working on restoring our indexing services.

  15. monitoring Oct 21, 2025, 12:19 AM UTC

    Our Engineering team has brought Indexing Service back. We are still seeing reporting panel fail to render, we are working with our backend team and vendor to bring it back. We will be updating the individual service status in the next couple hours as services stabilize.

  16. monitoring Oct 21, 2025, 02:40 AM UTC

    SMC and reporting panel is fully operational. Search, Indexing, and autocomplete fully back to normal state. We will be monitoring in the next 24 hours before we close this incident.

  17. monitoring Oct 21, 2025, 03:24 PM UTC

    Systems are back to normal. Team are doing clean ups, expected to mark the incident to "Resolved" by the end of today EST.

  18. resolved Oct 22, 2025, 03:54 AM UTC

    We have the incident fully resolved, all systems are stabilized.