Nanonets incident

Delayed file processing for all models using async api

Major Resolved View vendor source →

Nanonets experienced a major incident on April 11, 2025 affecting API, lasting 26m. The incident has been resolved; the full update timeline is below.

Started
Apr 11, 2025, 12:44 PM UTC
Resolved
Apr 11, 2025, 01:10 PM UTC
Duration
26m
Detected by Pingoru
Apr 11, 2025, 12:44 PM UTC

Affected components

API

Update timeline

  1. investigating Apr 11, 2025, 12:44 PM UTC

    We are currently investigating this issue.

  2. identified Apr 11, 2025, 12:47 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Apr 11, 2025, 12:59 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Apr 11, 2025, 01:10 PM UTC

    This incident has been resolved.

  5. postmortem Apr 11, 2025, 01:17 PM UTC

    On April 11th, 2025, between 11:35 AM UTC and 12:45 PM UTC, users experienced delays in file processing across all models on the async prediction API of [app.nanonets.com](http://app.nanonets.com). There is no impact on EU and IN region. The issue was caused by an internal service dependency that became bottlenecked, leading to a backlog in the processing queue. The root cause was promptly identified, and a fix was deployed to restore normal processing. We sincerely apologize for the inconvenience caused and we are taking steps to prevent similar occurrences in the future.