Sift incident

Delays in asynchronous Event API

Minor Resolved View vendor source →

Sift experienced a minor incident on November 28, 2018 affecting API, lasting 2h 57m. The incident has been resolved; the full update timeline is below.

Started
Nov 28, 2018, 04:47 PM UTC
Resolved
Nov 28, 2018, 07:45 PM UTC
Duration
2h 57m
Detected by Pingoru
Nov 28, 2018, 04:47 PM UTC

Affected components

API

Update timeline

  1. investigating Nov 28, 2018, 04:47 PM UTC

    We're experiencing delays in asynchronous Event API latencies.

  2. investigating Nov 28, 2018, 05:18 PM UTC

    We are continuing to investigate the situation.

  3. investigating Nov 28, 2018, 05:50 PM UTC

    We are currently experiencing a processing delay for events received through the Event API. Updated scores, data in Explore, and workflows may be delayed by up to 40 minutes after the event is received. This does not impact events sent with `?return_score=true` or `?return_workflow_status=true`. No data has been lost.

  4. monitoring Nov 28, 2018, 06:29 PM UTC

    We’re currently monitoring an improvement in handling events received through the Event API. Events sent with `?return_score=true` or `?return_workflow_status=true` have not been impacted. No data has been lost.

  5. resolved Nov 28, 2018, 07:45 PM UTC

    Processing delay in events received through the Event API has been resolved and is back to normal. No data has been lost.