Reepay experienced a notice incident on November 12, 2024 affecting Checkout, lasting 4h 41m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Nov 12, 2024, 09:53 AM UTC
From 10.15 to 10.21 CET we saw connection problems between load balancers and the Checkout API service, resulting in timeouts. We are currently investigating the cause of the problems. The service is now operating as normal.
- resolved Nov 12, 2024, 02:34 PM UTC
The root cause of the incident has been identified as an out of memory issue for the service entities. Recent changes to the service has slightly changed the memory consumption profile of the service, making it exhaust memory. Unhealthy service instances was automatically deprovisioned and new ones started, resolving the issue. The resource allocation has now been adjusted and monitoring put in place to discover potential resource starvation before the services become unresponsive. We apologize for the inconvenience this may have caused.