Cognito incident

Intermittent identity searches

Minor Resolved View vendor source →

Cognito experienced a minor incident on May 25, 2018 affecting API and Dashboard, lasting 1h 41m. The incident has been resolved; the full update timeline is below.

Started
May 25, 2018, 09:40 PM UTC
Resolved
May 25, 2018, 11:22 PM UTC
Duration
1h 41m
Detected by Pingoru
May 25, 2018, 09:40 PM UTC

Affected components

APIDashboard

Update timeline

  1. investigating May 25, 2018, 09:40 PM UTC

    We are investigating increased instances of errors occurring when creating identity searches and delayed queues.

  2. identified May 25, 2018, 09:46 PM UTC

    Automated routine maintenance by Heroku on a Redis instance is causing unexpected errors. We are working with Heroku engineers to remedy the situation as quickly as possible.

  3. identified May 25, 2018, 09:59 PM UTC

    We are continuing to work with Heroku engineers to remedy the issue.

  4. monitoring May 25, 2018, 10:04 PM UTC

    Searches have returned to normal and we are monitoring to ensure that everything is stable.

  5. resolved May 25, 2018, 11:22 PM UTC

    Systems have remained stable for over an hour. We apologize for this inconvenience and we will work with Heroku to ensure that it does not happen again.