Stonly Outage History

The issue is now fully resolved. We've determined that due to an unusual spike of traffic, our servers became overloaded at 8:59 UTC. Our monitoring caught the issue and scaling mechanisms kicked in, but due to large volume of traffic it took until 9:18 UTC to fully recover from the situation. Between those times, Knowledgebases and guides could occasionally fail to load, or load slower than normally. As next steps, we'll be reviewing our server capacity, reviewing our autoscaling mechanisms and thresholds, to be able to serve similar traffic spike's without interruptions.

We've confirmed all systems are stable now. This incident is now resolved.

All messages have been processed and sent. Issue is now resolved. Between Oct 10th, 21:13 and Oct 11th, 06:21 Contact Forms were not delivered to the recipients. Due to very small amount of contact form submissions within this timeframe, our monitoring didn't alert us until Oct 11th, 05:58, when amount of undelivered messages crossed the monitoring threshold. After learning about the issue our team quickly identified the underlying cause and restored contact form delivery.

A fix has been implemented and the issue is now resolved.

On September 4th, 2024, between 13:14 and 15:48 UTC, due to a configuration error, our targeting API endpoint at https://track.stonly.com was unreachable, returning 404 errors. After conducting a post-mortem, we've changed our change-management process for this part of the system and added additional alerts in case of it's unavailability.

The system was back to normal after 40 minutes.

Since 09:45 UTC the Contact Form message processing was delayed. Our team fixed the issue at 11:39

This incident has been resolved.