Rebuy experienced a minor incident on December 18, 2024 affecting Smart Cart, lasting 57m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 18, 2024, 12:20 PM UTC
We are currently receiving reports that Smart Cart v2 is experiencing intermittent loading issues for some customers. Legacy carts continue to function as expected, while v2 carts have temporarily reverted to the native cart. Our team is actively investigating the situation. Thank you for your patience.
- monitoring Dec 18, 2024, 01:10 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Dec 18, 2024, 01:17 PM UTC
The issue has been resolved, and our engineering team will conduct a root cause analysis. We will provide an update in this outage with the post-mortem once it is complete.
- postmortem Dec 19, 2024, 09:07 PM UTC
#### **What Happened** A high-demand process coincided with a scheduled daily job, leading to excessive resource usage in our database. This caused an overload, which resulted in an interruption of the **SmartCartV2 service**. **Initial Actions to Resolve the Outage** We adjusted the memory allocation for operations by increasing it from the default value. This change was applied dynamically without needing a full MySQL restart, minimizing disruption. #### **What We’re Doing Going Forward** 1. **Improved Resource Management:** * We’ve restructured how **SmartCartV2** data is processed to prevent resource conflicts between different tasks, such as the one that occurred in this instance. 2. **Update System Logic:** * Our applications will be updated to work seamlessly with this new data process, ensuring smooth and efficient performance with the new model.