Storj incident

Performance Impact

Major Resolved View vendor source →

Storj experienced a major incident on May 22, 2025 affecting AP1 - API and EU1 - API and 1 more component, lasting 32m. The incident has been resolved; the full update timeline is below.

Started
May 22, 2025, 12:57 AM UTC
Resolved
May 22, 2025, 01:30 AM UTC
Duration
32m
Detected by Pingoru
May 22, 2025, 12:57 AM UTC

Affected components

AP1 - APIEU1 - APIUS1 - APIAP1 - GatewayEU1 - GatewayUS1 - GatewayUS1 - Select

Update timeline

  1. investigating May 22, 2025, 01:28 AM UTC

    We are investigating reports of performance impacts to one or more components of our system.

  2. resolved May 22, 2025, 01:43 AM UTC

    This incident has been resolved.

  3. postmortem May 23, 2025, 05:19 PM UTC

    On May 22, 2025 from 00:12 to 02:54 UTC Storj experienced a service disruption causing elevated error rates and increased request latency that affected the US1 API, Gateway, Linksharing, and US1 - Select services. We discovered lock contention triggered by high-load delete operations. In the short term, we are artificially slowing down some of these intensive requests to leave needed headroom. We will eliminate the lock contention going forward.