Orb incident

Elevated errors across API endpoints

Notice Resolved View vendor source →

Orb experienced a notice incident on March 3, 2025 affecting Reads and Writes and 1 more component, lasting 1h 38m. The incident has been resolved; the full update timeline is below.

Started
Mar 03, 2025, 10:39 PM UTC
Resolved
Mar 04, 2025, 12:18 AM UTC
Duration
1h 38m
Detected by Pingoru
Mar 03, 2025, 10:39 PM UTC

Affected components

ReadsWritesAnalytics

Update timeline

  1. investigating Mar 03, 2025, 10:39 PM UTC

    We are investigating errors in the API as well as the web app

  2. monitoring Mar 03, 2025, 10:48 PM UTC

    We have rolled back a breaking change and APIs and the web app have recovered. We will continue to actively monitor our systems.

  3. monitoring Mar 03, 2025, 10:48 PM UTC

    We are continuing to monitor for any further issues.

  4. resolved Mar 04, 2025, 12:18 AM UTC

    Error rates resolved at 22:44 UTC, and we've seen no impact to services afterwards.