Sift incident

Workflows, Console, Explore, and Insights are having degraded performance

Minor Resolved View vendor source →

Sift experienced a minor incident on October 24, 2018 affecting Console and Workflows, lasting 5h 27m. The incident has been resolved; the full update timeline is below.

Started
Oct 24, 2018, 09:44 PM UTC
Resolved
Oct 25, 2018, 03:11 AM UTC
Duration
5h 27m
Detected by Pingoru
Oct 24, 2018, 09:44 PM UTC

Affected components

ConsoleWorkflows

Update timeline

  1. investigating Oct 24, 2018, 09:44 PM UTC

    We are currently experiencing event processing delays. Workflows, Explore, Insights and the Sift Console may not include event data received after 6AM PDT. The Event API is up and no data has been lost. Event API calls with "return_workflow_status=true" or "return_score=true" will be returning up-to-date workflows and scores.

  2. investigating Oct 24, 2018, 11:36 PM UTC

    We are taking efforts to speed up the processing.

  3. monitoring Oct 25, 2018, 12:28 AM UTC

    We've implemented measures to speed up processing the backlog of data. We're monitoring the backlog and will update when it's cleared.

  4. resolved Oct 25, 2018, 03:11 AM UTC

    Backlog have been cleared.