Ocrolus incident

Overdue Documents

Major Resolved View vendor source →

Ocrolus experienced a major incident on December 28, 2023 affecting Document Processing, lasting 6h 12m. The incident has been resolved; the full update timeline is below.

Started
Dec 28, 2023, 05:29 PM UTC
Resolved
Dec 28, 2023, 11:41 PM UTC
Duration
6h 12m
Detected by Pingoru
Dec 28, 2023, 05:29 PM UTC

Affected components

Document Processing

Update timeline

  1. investigating Dec 28, 2023, 05:29 PM UTC

    We are currently experiencing intermittent outages with our human-in-the-loop verification system that will result in longer turnaround times for documents that require human verification. We are still investigating the root cause. The Ocrolus API and Dashboard are not affected by this incident.

  2. identified Dec 28, 2023, 06:40 PM UTC

    This incident was caused by a queuing system failure that occurred around 10:50am ET. Our human-in-the-loop verification system is now fully operational and we are currently working through the backlog.

  3. monitoring Dec 28, 2023, 09:11 PM UTC

    We are about 3/4 of the way through the backlog.

  4. resolved Dec 28, 2023, 11:41 PM UTC

    We have completed processing the backlog. We will continue our investigation of the incident and will provide a postmortem in the next few business days.