Permutive incident

Analytics dashboard timeouts

Notice Resolved View vendor source →

Permutive experienced a notice incident on October 30, 2019 affecting Permutive Analytics, lasting 6h 28m. The incident has been resolved; the full update timeline is below.

Started
Oct 30, 2019, 10:34 AM UTC
Resolved
Oct 30, 2019, 05:03 PM UTC
Duration
6h 28m
Detected by Pingoru
Oct 30, 2019, 10:34 AM UTC

Affected components

Permutive Analytics

Update timeline

  1. monitoring Oct 30, 2019, 10:34 AM UTC

    On Thursday 24th October, we began seeing a higher rate of timeouts in our analytics dashboard. While this was not a consistent problem, several of our customers have been impacted over the following days. We have identified a defect in one of our background data reconciliation processes that we believe caused our data warehouse to become less performant. This in turn had a negative impact on our analytics tools. We have rolled out a fix to the defect and will monitor the outcome.

  2. resolved Oct 30, 2019, 05:03 PM UTC

    After monitoring our system throughout the day we can confirm that this problem is now resolved.