Lucidworks incident

Connected Search and Experience Optimizer functionality impaired

Notice Resolved View vendor source →

Lucidworks experienced a notice incident on January 6, 2023 affecting Lucidworks Platform, lasting 5h 38m. The incident has been resolved; the full update timeline is below.

Started
Jan 06, 2023, 10:36 AM UTC
Resolved
Jan 06, 2023, 04:15 PM UTC
Duration
5h 38m
Detected by Pingoru
Jan 06, 2023, 10:36 AM UTC

Affected components

Lucidworks Platform

Update timeline

  1. investigating Jan 09, 2023, 11:20 PM UTC

    The Lucidworks Connected Search platform is experiencing an issue with routing traffic that is resulting in failed search query requests. This issue is also affecting the ability to use Experience Optimizer from within the platform web interface.

  2. investigating Jan 09, 2023, 11:21 PM UTC

    We have mitigated the issue, and all search functionality (including both API-based search requests, as well as the ability to use Experience Optimizer in our platform UI) has been restored.

  3. resolved Jan 09, 2023, 11:23 PM UTC

    An internal routing component of Connected Search had gotten into a stuck state where it could not validate a newly-rotated TLS certificate used to route traffic to the search backend. By restarting this component, we were able to mitigate the issue. We have updated our tooling to force a restart of this component every time the TLS certificate is rotated, in order to avoid a recurrence.

  4. postmortem Jan 12, 2023, 03:28 AM UTC

    Connected Search customers who were affected by this incident may request a detailed Event Analysis via Lucidworks Support.