Form3 Staging incident

INC-30497 - Degradation to Bacs Simulator

Minor Resolved View vendor source →

Form3 Staging experienced a minor incident on December 13, 2021 affecting Bacs - Direct Participant, lasting 52m. The incident has been resolved; the full update timeline is below.

Started
Dec 13, 2021, 02:46 PM UTC
Resolved
Dec 13, 2021, 03:39 PM UTC
Duration
52m
Detected by Pingoru
Dec 13, 2021, 02:46 PM UTC

Affected components

Bacs - Direct Participant

Update timeline

  1. investigating Dec 13, 2021, 02:46 PM UTC

    We have identified an issue impacting the Bacs simulator since 08:00 Our engineers are currently investigating and further details will be posted as the investigation progresses

  2. resolved Dec 13, 2021, 03:39 PM UTC

    Our Bacs simulator has recovered and normal service has resumed as of 15:17 UTC. During the impacted period there was a latency on inbound and outbound payments. We will continue to monitor the service to ensure there is no ongoing impact.

  3. postmortem Dec 15, 2021, 01:39 PM UTC

    Form3 were alerted to a degradation in the Bacs simulator from 08:00-15:17 UTC, causing a latency on payments reaching final state. Investigations identified that there were transactions that were accumulating because of a misconfiguration. Once the misconfiguration was fixed, no further latency was observed. Form3 continue to proactively monitor the Staging environment to identify service enhancements and to prevent impact to customer testing.