Form3 Staging incident

#61756 Degradation to Bacs Simulator

Minor Resolved View vendor source →

Form3 Staging experienced a minor incident on October 27, 2022 affecting Bacs - Direct Participant, lasting 4h. The incident has been resolved; the full update timeline is below.

Started
Oct 27, 2022, 12:42 PM UTC
Resolved
Oct 27, 2022, 04:43 PM UTC
Duration
4h
Detected by Pingoru
Oct 27, 2022, 12:42 PM UTC

Affected components

Bacs - Direct Participant

Update timeline

  1. investigating Oct 27, 2022, 12:42 PM UTC

    We have identified an issue impacting the Bacs simulator. Our engineers are currently investigating and further details will be posted as the investigation progresses

  2. identified Oct 27, 2022, 12:53 PM UTC

    The issue has been identified and a fix is being progressed. Currently all outbound payments processed in the Simulator are working as usual, however the inbound payments are not being generated.

  3. resolved Oct 27, 2022, 04:43 PM UTC

    A fix for the identified issue has been applied and service has been restored to the Bacs simulator. We will now monitor the service overnight to ensure no further issues are experienced.

  4. postmortem Oct 28, 2022, 10:26 AM UTC

    On Thursday 27th October, Form3 observed performance degradation on the Bacs Simulator. Investigation identified that a configuration change made had caused an unexpected impact on the Bacs Simulator, which resulted in inbound test transactions not being processed as usual. Upon identifying the root cause, a fix was implemented at 16:26 BST. A period of monitoring then followed which confirmed there was no further impact to the Bacs Simulator and transactions were being processed as expected.