Sift incident

Console indexing outage

Minor Resolved View vendor source →

Sift experienced a minor incident on August 25, 2022 affecting Console, lasting 9h 59m. The incident has been resolved; the full update timeline is below.

Started
Aug 25, 2022, 06:30 PM UTC
Resolved
Aug 26, 2022, 04:30 AM UTC
Duration
9h 59m
Detected by Pingoru
Aug 25, 2022, 06:30 PM UTC

Affected components

Console

Update timeline

  1. identified Aug 25, 2022, 06:30 PM UTC

    Sift has identified an issue with our indexing service as of 7:30am Pacific. We are actively working on restoring the service. This only impacts console indexing - Explore and search, but does not impact any data ingestion or APIs. All score and decision pipelines are unaffected. Links to specific users in the Sift console & Review Queues are unaffected.

  2. identified Aug 25, 2022, 08:33 PM UTC

    Sift is continuing to work on recovering our indexing service.

  3. identified Aug 25, 2022, 08:35 PM UTC

    We are continuing to work on a fix for this issue.

  4. identified Aug 25, 2022, 11:10 PM UTC

    We have resolved the console indexing service issue and now processing the backlog of events since the incident started. We are closely monitoring the service to ensure there are no further incidents.

  5. monitoring Aug 25, 2022, 11:25 PM UTC

    We have resolved the console indexing service issue and now processing the backlog of events since the incident started. We are closely monitoring the service to ensure there are no further incidents.

  6. monitoring Aug 26, 2022, 04:28 AM UTC

    We are continuing to monitor for any further issues.

  7. resolved Aug 26, 2022, 04:30 AM UTC

    At this time the issue with Console Indexing service has been resolved. At Sift we value product excellence. Our customers should expect nothing less. We will work hard to ensure this and similar incidents cannot be repeated. Thanks for fighting fraud with Sift Science.