CrystalCommerce incident

Search Index Issues

Major Resolved View vendor source →

CrystalCommerce experienced a major incident on December 15, 2022 affecting POS and Frontend, lasting 5d 23h. The incident has been resolved; the full update timeline is below.

Started
Dec 15, 2022, 09:13 PM UTC
Resolved
Dec 21, 2022, 08:39 PM UTC
Duration
5d 23h
Detected by Pingoru
Dec 15, 2022, 09:13 PM UTC

Affected components

POSFrontend

Update timeline

  1. investigating Dec 15, 2022, 09:13 PM UTC

    We are seeing errors with the search indexes across our system, and are working on finding a solution. Symptoms of the issue include recently added products not appearing on website and/or POS searches, Products not showing up in the POS unless it's set to "out of stock visible", and banner updates not displaying on frontend websites.

  2. monitoring Dec 20, 2022, 01:53 AM UTC

    We've identified the issue and implemented a fix. We are currently running a script to rebuild everyone's search index.

  3. resolved Dec 21, 2022, 08:39 PM UTC

    The script has finished running, and search indexes are working now.