Ocrolus incident

Detect Outage

Major Resolved View vendor source →

Ocrolus experienced a major incident on April 1, 2024 affecting Ocrolus API and Dashboard, lasting 7h 40m. The incident has been resolved; the full update timeline is below.

Started
Apr 01, 2024, 07:24 PM UTC
Resolved
Apr 02, 2024, 03:04 AM UTC
Duration
7h 40m
Detected by Pingoru
Apr 01, 2024, 07:24 PM UTC

Affected components

Ocrolus APIDashboard

Update timeline

  1. investigating Apr 01, 2024, 07:24 PM UTC

    We are currently investigating delays with Detect signal generation that began at approximately 1pm ET.

  2. investigating Apr 01, 2024, 08:26 PM UTC

    We are currently taking remediation steps to resolve this issue within the next 2 hours.

  3. monitoring Apr 01, 2024, 08:50 PM UTC

    Our Detect system is starting to recover and the backlog is being processed.

  4. investigating Apr 01, 2024, 09:35 PM UTC

    The signs of recovery were short-lived, and we are continuing to see failures and delays with Detect signal generation.

  5. identified Apr 02, 2024, 01:31 AM UTC

    We have identified a potential root cause and are in the process of deploying a software update.

  6. monitoring Apr 02, 2024, 02:06 AM UTC

    The software update was successful and the Detect backlog is being processed.

  7. monitoring Apr 02, 2024, 02:47 AM UTC

    Approximately 90% of the Detect backlog has been processed, and Detect processing times have returned to normal for newly verified documents.

  8. resolved Apr 02, 2024, 03:04 AM UTC

    The backlog has been processed completely and Detect is fully functional.