Zūm Rails experienced a major incident on July 9, 2021 affecting Visa Direct, lasting 2d 21h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jul 08, 2021, 04:32 PM UTC
Visa Direct transactions are failing due a Visa timeout. The response in Zum API is VisaDirectRejectedAccountLimitExceeded. We contacted Visa and its partners and they are fixing the issue in their side. As soon as they fix we will update this status page and transaction will start working again. ETA is 1:30 PM (EST).
- identified Jul 08, 2021, 04:58 PM UTC
We are continuing to work on a fix for this issue.
- identified Jul 08, 2021, 06:03 PM UTC
We are continuing to work with Visa on a solution for this, new ETA is 4pm EST.
- identified Jul 08, 2021, 08:27 PM UTC
We are continuing to work with Visa on a solution for this, new ETA is 6pm EST.
- identified Jul 08, 2021, 09:07 PM UTC
Visa still fixing the issue on their side and the new ETA is tomorrow (July 09) by 10:30am (EST). Their team already found the problem and informed Zum that their team may be able to correct the issue today however, they guarantee it by tomorrow morning (10:30am). More details: The reason for the lengthy delay is due to a misconfiguration on Visa Direct rails with Financial Institutions which requires multiple parties to send updated information to Visa.
- identified Jul 09, 2021, 03:22 PM UTC
Visa has addressed and resolved the situation, a compliance check is underway to validate the recent system changes and a further update is expected at Noon
- monitoring Jul 09, 2021, 04:46 PM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Jul 09, 2021, 05:38 PM UTC
The incident between Visa Direct and the bank has been solved, transactions were working without problems from noon to 1 pm EST, however, for compliance and verification it is required to have some transactions settled with the new solution in place. Unfortunately, this means that we have to wait for Monday morning's settlement to happen so Visa has closed the system until then. Everything should be up and running by 9:30 am Monday.
- monitoring Jul 12, 2021, 01:18 PM UTC
We got informed by Visa and PeoplesTrust that the service should be restarted at 10:30am (EST). We are monitoring and as soon it's resolved this page will be updated.
- resolved Jul 12, 2021, 03:16 PM UTC
This incident has been resolved.