Sift incident

Increased Score API and synchronous Event API latencies

Minor Resolved View vendor source →

Sift experienced a minor incident on November 8, 2018 affecting API and Score, lasting 6h 13m. The incident has been resolved; the full update timeline is below.

Started
Nov 08, 2018, 08:23 PM UTC
Resolved
Nov 09, 2018, 02:37 AM UTC
Duration
6h 13m
Detected by Pingoru
Nov 08, 2018, 08:23 PM UTC

Affected components

APIScore

Update timeline

  1. investigating Nov 08, 2018, 08:23 PM UTC

    We are currently investigating intermittent increases in latency for Score API requests and Event API requests with return_workflow_status=true or return_score=true. This is impacting 1-5% of requests. No data has been lost.

  2. investigating Nov 08, 2018, 08:57 PM UTC

    We are continuing to investigate intermittent increases in latency for Score API requests and Event API requests with return_workflow_status=true or return_score=true. This is impacting 1-5% of requests. No data has been lost.

  3. investigating Nov 08, 2018, 09:25 PM UTC

    We continue to investigate intermittent increases in latency for Score API requests and Event API requests with return_workflow_status=true or return_score=true. This is impacting 1-5% of requests. No data has been lost.

  4. investigating Nov 08, 2018, 09:47 PM UTC

    We have identified the issue and are rolling out changes over the next few hours that will address the issue. Intermittent latency increases for 1-5% requests may continue during that time, until approximately 7pm PST. This status will be updated when the latency issues have been resolved or if there is new information to report.

  5. identified Nov 08, 2018, 09:48 PM UTC

    The issue has been identified and a fix is being implemented.

  6. resolved Nov 09, 2018, 02:37 AM UTC

    Our planned improvements have been completed. Score API and Event API latencies are now back to normal rates.