Voucherify experienced a minor incident on March 10, 2025 affecting US1 - API, lasting 6h 8m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Mar 10, 2025, 09:51 AM UTC
We've been experiencing an elevated rate of API errors over the course of Saturday and Sunday. The issue would crash one of our virtual machines in the US1 cluster once every couple of hours, resulting in a burst of HTTP 500 errors until it would self-heal and stabilize just minutes later, affecting some percent of the incoming traffic. The root cause of the issue is now identified, we already have a temporary fix in place on production, and the ultimate fix is being implemented and expected to be deployed within the next hours.
- monitoring Mar 10, 2025, 03:16 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Mar 10, 2025, 04:00 PM UTC
This incident has been resolved.