Nosto incident

Recommendations and content are not appearing on websites

Major Resolved View vendor source →

Nosto experienced a major incident on January 3, 2024 affecting Onsite products and Emails and 1 more component, lasting 8h 13m. The incident has been resolved; the full update timeline is below.

Started
Jan 03, 2024, 06:59 PM UTC
Resolved
Jan 04, 2024, 03:12 AM UTC
Duration
8h 13m
Detected by Pingoru
Jan 03, 2024, 06:59 PM UTC

Affected components

Onsite productsEmailsAdmin panelAPI

Update timeline

  1. identified Jan 03, 2024, 06:59 PM UTC

    We experienced issues with our primary database cluster servicing recommendations. The issues started at 1:54 PM EET(06:54 AM EST). The Nosto Search is not affected. The issues impacted both the Nosto Admin panel and customer websites and other mediums where recommendations are displayed. We were able to bring the secondary cluster up around 4:30 PM EET (8:30 AM EST). Unfortunately the secondary cluster does not have the latest product updates and changes to the products are not reflected to the secondary cluster, but product recommendations are displayed. We are still continuing to work to bring the primary clusters back up. Once the primary cluster is fully up and traffic directed there, all services will be back to full operation. Primary cluster was brought up 5:12 AM EET ( 22:12 PM EST).

  2. resolved Jan 04, 2024, 04:10 AM UTC

    This incident has been resolved.