FinDock incident

GoCardless notifications not always delivered correctly and temporarily paused

Notice Resolved View vendor source →

FinDock experienced a notice incident on April 6, 2023 affecting (Online) Payment API / Payment Service Providers, lasting 3h 3m. The incident has been resolved; the full update timeline is below.

Started
Apr 06, 2023, 07:44 AM UTC
Resolved
Apr 06, 2023, 10:48 AM UTC
Duration
3h 3m
Detected by Pingoru
Apr 06, 2023, 07:44 AM UTC

Affected components

(Online) Payment API / Payment Service Providers

Update timeline

  1. investigating Apr 06, 2023, 07:44 AM UTC

    Please note: this incident only applies to GoCardless customers. Notifications received on the Notification Gateway from GoCardless are not always correctly delivered. We identified the root cause and are working on a hotfix as soon as possible. We will be able to retry not delivered notifications after the fix is deployed, meaning notifications are delivered at a later time but not lost. You might find failed unexpected Inbound Reports in your environment, these can be ignored. To prevent more problems while we are working on the fix we’ve temporarily disabled accepting GoCardless messages as a whole in production. Customers will experience a delay in notifications until this is resolved.

  2. monitoring Apr 06, 2023, 09:00 AM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Apr 06, 2023, 10:48 AM UTC

    The incident has been resolved and we've confirmed the fix works as expected. All GoCardless notifications since the FinDock production release on Mar 26, 2023 have been re-send and are automatically processed if they haven't been processed previously. FinDock will further investigate how incident could have happened and take actions accordingly. Please contact FinDock Support (www.findock.com/support) if you have any questions.