Banked experienced a critical incident on July 28, 2023 affecting API and Checkout, lasting 1h 17m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 28, 2023, 09:44 AM UTC
We are currently experiencing a performance degradation to the API and checkout service. Investigations are ongoing and an update will be provided as soon as more information becomes available.
- identified Jul 28, 2023, 10:03 AM UTC
The issue has been identified and a fix is being implemented.
- identified Jul 28, 2023, 10:32 AM UTC
We are continuing to work on a fix for this issue.
- monitoring Jul 28, 2023, 10:36 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jul 28, 2023, 11:01 AM UTC
This incident has been resolved.
- postmortem Jul 31, 2023, 03:27 PM UTC
On July 28th, 2023 between 9:38 -10:35 UTC, Banked experienced an outage in the payments API and checkout product. During the outage, most attempts to create payments failed. This issue occurred during a platform upgrade to our clusters that caused a failure in one of our core components. Our on-call team responded immediately to the failure and started a recovery process to return the system to healthy state. We have already begun and are continuing to work on improving our infrastructure components and their resilience.