Permutive incident

Dashboard service degredation

Major Resolved View vendor source →

Permutive experienced a major incident on July 29, 2019 affecting Permutive Dashboard, lasting 24m. The incident has been resolved; the full update timeline is below.

Started
Jul 29, 2019, 03:18 PM UTC
Resolved
Jul 29, 2019, 03:43 PM UTC
Duration
24m
Detected by Pingoru
Jul 29, 2019, 03:18 PM UTC

Affected components

Permutive Dashboard

Update timeline

  1. investigating Jul 29, 2019, 03:18 PM UTC

    We've received reports that our dashboard is returning results slowly and is failing some requests. We're investigating the root cause and we will update as soon as we know more.

  2. identified Jul 29, 2019, 03:27 PM UTC

    One of our downstream SaaS service providers is experiencing unexpected down-time, which caused an unexpected fault in our management service which powers our dashboard. We're implementing a fix a which should be effective in the next 10 minutes.

  3. monitoring Jul 29, 2019, 03:30 PM UTC

    The upstream service provider has resolved their issue, so our dashboard is returning to normal functionality. We're currently deploying a fix to prevent this issue reoccurring.

  4. resolved Jul 29, 2019, 03:43 PM UTC

    The issue has been resolved and all services are returning to normal.