Cognito incident

Elevated upstream data provider errors

Major Resolved View vendor source →

Cognito experienced a major incident on December 12, 2018 affecting API and Dashboard, lasting 1h 47m. The incident has been resolved; the full update timeline is below.

Started
Dec 12, 2018, 01:12 AM UTC
Resolved
Dec 12, 2018, 02:59 AM UTC
Duration
1h 47m
Detected by Pingoru
Dec 12, 2018, 01:12 AM UTC

Affected components

APIDashboard

Update timeline

  1. investigating Dec 12, 2018, 01:12 AM UTC

    We are investigating an increased error rate with an upstream provider. We are in contact with them and are working towards a solution.

  2. identified Dec 12, 2018, 01:23 AM UTC

    The upstream provider has discovered the issue and they are working to remedy it as quickly as possible.

  3. monitoring Dec 12, 2018, 01:38 AM UTC

    Services are currently operating normally. We are monitoring the situation to ensure that no regressions occur.

  4. monitoring Dec 12, 2018, 01:55 AM UTC

    We are continuing to monitor for any further issues.

  5. resolved Dec 12, 2018, 02:59 AM UTC

    The issues have been fully resolved, we apologize for any inconvenience this has caused. We have been in the process of adding additional redundancy for this particular provider and will continue to work to do so to ensure this does not happen again in the future.