Sleuth incident

Reduced performance across the board

Notice Resolved View vendor source →

Sleuth experienced a notice incident on October 14, 2023 affecting impact tracking and deploy processing, lasting 4h 23m. The incident has been resolved; the full update timeline is below.

Started
Oct 14, 2023, 07:14 PM UTC
Resolved
Oct 14, 2023, 11:38 PM UTC
Duration
4h 23m
Detected by Pingoru
Oct 14, 2023, 07:14 PM UTC

Affected components

impact trackingdeploy processing

Update timeline

  1. investigating Oct 14, 2023, 07:14 PM UTC

    We are currently investigating this issue.

  2. investigating Oct 14, 2023, 09:01 PM UTC

    We identified a database issue related to the recent upgrade, and performance seems to be returning to normal. We will continue to monitor the situation

  3. monitoring Oct 14, 2023, 09:02 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Oct 14, 2023, 11:38 PM UTC

    Why, oh why is 'ANALYZE VERBOSE' not automatically ran on a major Postgres upgrade :( (we are all green across the board, and even faster, if you can believe it)