Cheddar incident

PayPal IPN Failures

Minor Resolved View vendor source →

Cheddar experienced a minor incident on September 11, 2018 affecting PayPal, lasting 20h 10m. The incident has been resolved; the full update timeline is below.

Started
Sep 11, 2018, 11:14 PM UTC
Resolved
Sep 12, 2018, 07:24 PM UTC
Duration
20h 10m
Detected by Pingoru
Sep 11, 2018, 11:14 PM UTC

Affected components

PayPal

Update timeline

  1. investigating Sep 11, 2018, 11:14 PM UTC

    As of 11/Sep/2018:03:51:49 UTC Cheddar stopped receiving IPNs (instant payment notifications) from PayPal. As a result, Cheddar merchants using PayPal Adaptive Payments Preapprovals for payment processing are reporting that their customers are unable to create new preapprovals at this time. Recurring transactions for existing customers are not affected by this issue. We're currently working with PayPal support to resolve the issue as soon as possible.

  2. monitoring Sep 12, 2018, 02:12 PM UTC

    Cheddar is now successfully receiving IPNs from PayPal. Customers of Cheddar merchants using PayPal Adaptive Payments Preapprovals should now be able to create new preapprovals. We recommend that Cheddar merchants using preapprovals check their IPN history in their PayPal account. If there are any IPNs from the past 48 hours with a status other than "sent," please retry the IPN. If the retry is successful, Cheddar will update any customer records in a PayPal Pending status with the accepted preapproval. We are continuing to monitor the situation.

  3. resolved Sep 12, 2018, 07:24 PM UTC

    PayPal has confirmed that this issue is now resolved.