Nanonets incident
File prediction errors for instant learning models in US region
Nanonets experienced a major incident on January 21, 2025 affecting API, lasting 16m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 21, 2025, 10:32 AM UTC
We are currently investigating this issue.
- identified Jan 21, 2025, 10:37 AM UTC
The issue has been identified and a fix is being implemented.
- monitoring Jan 21, 2025, 10:42 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jan 21, 2025, 10:49 AM UTC
This incident has been resolved.
- postmortem Jan 21, 2025, 11:08 AM UTC
**Incident Summary:** Between **03:50 PM IST and 04:08 PM IST** on January 21, 2025, users of `app.nanonets.com` experienced failures in processing requests related to Instant Learning Models. This issue was isolated to our secondary db, which encountered an operational issue, causing request failures. All other APIs and services remained unaffected. **Resolution:** The above issue impacted reads for Instant Learning Models. Our engineering team promptly resolved the read replica issue, restoring full service functionality. The platform is now operating as expected. We sincerely apologize for the inconvenience caused and deeply regret the disruption to our users. Ensuring high availability and reliability of our services is our top priority.