Cheddar incident

Unable to run transactions

Minor Resolved View vendor source →

Cheddar experienced a minor incident on March 28, 2018, lasting 1h 57m. The incident has been resolved; the full update timeline is below.

Started
Mar 28, 2018, 07:14 PM UTC
Resolved
Mar 28, 2018, 09:12 PM UTC
Duration
1h 57m
Detected by Pingoru
Mar 28, 2018, 07:14 PM UTC

Update timeline

  1. investigating Mar 28, 2018, 07:14 PM UTC

    We've received alerts indicating that transaction running is failing.

  2. identified Mar 28, 2018, 07:47 PM UTC

    The cause has been identified and a fix is in progress.

  3. monitoring Mar 28, 2018, 07:54 PM UTC

    The fix has been implemented and verified. We are continuing to monitor for abnormalities.

  4. monitoring Mar 28, 2018, 08:11 PM UTC

    All new transactions are currently succeeding. Recurring transactions attempted during the incident are continuing to fail when retried. This is being investigated.

  5. monitoring Mar 28, 2018, 08:52 PM UTC

    Transactions are executing normally. Recurring transactions that failed during the incident will retry automatically and are expected to run as normal.

  6. resolved Mar 28, 2018, 09:12 PM UTC

    All transactions are executing normally. Retries of errant transactions have completed.