Stonly incident
Slow loading times and intermittent service unavailability for widgets and knowledgebases
Stonly experienced a major incident on October 29, 2024 affecting Stonly Widget and Stonly customers KB's - location N and 1 more component, lasting 1h 33m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 29, 2024, 09:20 AM UTC
We are investigating an increased load on our systems causing slow load times and occasional failure to load knowledgebases and widgets
- monitoring Oct 29, 2024, 09:25 AM UTC
The platform is stable now under traffic, we keep monitoring the situation
- resolved Oct 29, 2024, 10:34 AM UTC
The issue is now fully resolved. We've determined that due to an unusual spike of traffic, our servers became overloaded at 8:59 UTC. Our monitoring caught the issue and scaling mechanisms kicked in, but due to large volume of traffic it took until 9:18 UTC to fully recover from the situation. Between those times, Knowledgebases and guides could occasionally fail to load, or load slower than normally. As next steps, we'll be reviewing our server capacity, reviewing our autoscaling mechanisms and thresholds, to be able to serve similar traffic spike's without interruptions.