BlockChyp incident

Increased timeouts and declines

Notice Resolved View vendor source →

BlockChyp experienced a notice incident on December 15, 2021 affecting Processing Back Ends, lasting 32m. The incident has been resolved; the full update timeline is below.

Started
Dec 15, 2021, 03:47 PM UTC
Resolved
Dec 15, 2021, 04:20 PM UTC
Duration
32m
Detected by Pingoru
Dec 15, 2021, 03:47 PM UTC

Affected components

Processing Back Ends

Update timeline

  1. investigating Dec 15, 2021, 03:47 PM UTC

    We are investigating reports of increased timeouts and decline responses.

  2. resolved Dec 15, 2021, 04:20 PM UTC

    We have observed no errors in the past 15 minutes, authorization times and decline rates have returned to normal.

  3. postmortem Dec 15, 2021, 09:33 PM UTC

    We have concluded our post-mortem investigation on this incident and have concluded that the root cause was an internet connectivity problem in the us-west region of **Amazon Web Services**. The issue was specifically caused by network congestion between parts of the AWS Backbone and a subset of Internet Service Providers, which was triggered by AWS traffic engineering.