Storj Outage History

Started Feb 06, 2025, 02:00 PM UTC· resolved Feb 06, 2025, 02:25 PM UTC

1. resolved Feb 06, 2025, 04:12 PM UTC

   API pod started experiencing issues at 14:09 UTC. It was taken out of rotation at 14:25 UTC, resolving the incident.

Read the full incident report →

Started Feb 01, 2025, 11:23 PM UTC· resolved Feb 02, 2025, 12:54 AM UTC

1. investigating Feb 01, 2025, 11:23 PM UTC

   We are investigating reports of performance impacts to one or more components of our system in the EU1 metadata region.

2. monitoring Feb 01, 2025, 11:58 PM UTC

   A fix has been implemented and we are monitoring the results.

3. resolved Feb 02, 2025, 12:54 AM UTC

   The previously identified issue has been resolved.

Read the full incident report →

Started Jan 07, 2025, 04:13 PM UTC· resolved Jan 07, 2025, 04:13 PM UTC

1. resolved Jan 07, 2025, 04:13 PM UTC

   Duration: December 19, 2024 - January 7, 2025 Customers experienced intermittent failures when attempting to list objects in storage buckets. Affected users received incomplete bucket listings, with some objects not appearing in their directory listings. This issue did not affect object storage or retrieval operations. As of January 7, 2025, full object listing functionality has been restored and validated across all regions. For customers who experienced this issue: We recommend performing a fresh listing of your buckets to confirm all objects are now visible. If you continue to observe any inconsistencies, please contact our support team. We apologize for any disruption this may have caused to your operations. We are implementing additional monitoring and failsafes to prevent similar incidents in the future.

Read the full incident report →

Started Dec 19, 2024, 02:48 AM UTC· resolved Dec 19, 2024, 06:01 AM UTC

1. investigating Dec 19, 2024, 02:48 AM UTC

   We are currently investigating this issue.

2. investigating Dec 19, 2024, 02:55 AM UTC

   Investigating increased error rates.

3. identified Dec 19, 2024, 04:08 AM UTC

   The issue has been identified and a fix is being implemented.

4. monitoring Dec 19, 2024, 05:23 AM UTC

   A fix has been implemented and we are monitoring the results.

5. resolved Dec 19, 2024, 06:01 AM UTC

   This incident has been resolved.

Read the full incident report →

Started Dec 14, 2024, 06:13 PM UTC· resolved Dec 14, 2024, 06:58 PM UTC

1. identified Dec 14, 2024, 06:13 PM UTC

   Today, at approximately 5:50PM UTC, the AP1 satellite was affected by an issue wherein all API keys were rendered inoperational. We have identified the issue and are working on a fix. Thank you for your patience.

2. monitoring Dec 14, 2024, 06:14 PM UTC

   We have implemented a fix and are monitoring the situation.

3. resolved Dec 14, 2024, 06:58 PM UTC

   The incident has been resolved.

Read the full incident report →

Started Nov 22, 2024, 09:28 PM UTC· resolved Nov 22, 2024, 11:26 PM UTC

1. investigating Nov 22, 2024, 09:28 PM UTC

   We are currently investigating the issue.

2. investigating Nov 22, 2024, 09:36 PM UTC

   We are continuing to investigate this issue.

3. investigating Nov 22, 2024, 10:25 PM UTC

   We are continuing to investigate this issue.

4. identified Nov 22, 2024, 10:33 PM UTC

   The issue has been identified and a fix is being implemented.

5. monitoring Nov 22, 2024, 11:18 PM UTC

   A fix has been implemented and we are monitoring the results.

6. resolved Nov 22, 2024, 11:26 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Nov 08, 2024, 02:43 PM UTC· resolved Nov 08, 2024, 11:34 PM UTC

1. investigating Nov 08, 2024, 02:43 PM UTC

   We are experiencing an issue with edge services' outage affecting customers in the Europe and North America regions. Our engineering team is actively investigating. We apologize to all who are affected by the disruption.

2. identified Nov 08, 2024, 03:38 PM UTC

   The issue has been identified and a fix is being implemented. The team will send another update in 15 minutes.

3. identified Nov 08, 2024, 03:58 PM UTC

   We've implemented a fix and gateway services (S3 API) is gradually coming back online. Linksharing is still experiencing an issue.

4. identified Nov 08, 2024, 04:20 PM UTC

   We are continuing to bring gateway services (S3 API) back online, requests in U.S. are seeing error rates decrease. E.U. gateway services are coming back online.

5. identified Nov 08, 2024, 04:30 PM UTC

   U.S. Gateway (S3 API) services are restored. E.U. Gateway services are seeing decreased error rates and will be restored soon.

6. identified Nov 08, 2024, 04:35 PM UTC

   E.U. Gateway services (S3 API) are restored. The team is focusing on bringing back online linksharing next.

7. identified Nov 08, 2024, 05:08 PM UTC

   Gateway services (S3 API) are still online and functioning normally. Linksharing is being brought back online.

8. identified Nov 08, 2024, 05:15 PM UTC

   Linksharing is being brought online in the U.S. and error rates are dropping. E.U. will be restored next.

9. monitoring Nov 08, 2024, 05:29 PM UTC

   All services are operational. We are continuing to monitor.

10. monitoring Nov 08, 2024, 05:44 PM UTC

    US1 API is now experiencing errors affecting all US1 services (gateway, linksharing, uplink). EU1 and AP1 are unaffected.

11. monitoring Nov 08, 2024, 06:18 PM UTC

    US1 API has been restored, we are monitoring linksharing and gateway but error rates are decreasing. EU1 and AP1 continue to function normally.

12. monitoring Nov 08, 2024, 06:44 PM UTC

    US1 API services are operational. We are still monitoring US1 linksharing and gateway elevated error rates. EU1 Linksharing and EU1 gateway are also now seeing elevated error rates.

13. monitoring Nov 08, 2024, 07:10 PM UTC

    We are deploying an additional fix. All services are stabilizing, but the situation is ongoing so we continue to monitor and fix as we see issues.

14. monitoring Nov 08, 2024, 08:03 PM UTC

    All services have been restored for nearly all customers. We are currently addressing isolated cases with individual customers to ensure full resolution. We continue to monitor.

15. resolved Nov 08, 2024, 11:34 PM UTC

    After extended monitoring, we are marking this incident as resolved. We again apologize to all who are affected by the disruption and appreciate your patience and support. The team will conduct a post mortem and we share more details as we investigate fully.

Read the full incident report →

Started Nov 05, 2024, 09:40 AM UTC· resolved Nov 05, 2024, 11:37 AM UTC

1. investigating Nov 05, 2024, 09:40 AM UTC

   We are experiencing an issue with edge services' outage in the Europe region. Our engineering team is actively investigating. We apologize to all who are affected by the disruption.

2. monitoring Nov 05, 2024, 09:58 AM UTC

   The emergency team has implemented a mitigation in which all users from the Europe region will be rerouted to North America. We are actively investigating bringing back Europe and apologize to all who are affected by the disruption.

3. resolved Nov 05, 2024, 11:37 AM UTC

   The issue with edge services' outage in the Europe region has been resolved for all affected users. We thank you for your patience while we worked on resolving the issue.

Read the full incident report →

Started Nov 03, 2024, 10:47 AM UTC· resolved Nov 04, 2024, 01:00 AM UTC

1. identified Nov 03, 2024, 10:47 AM UTC

   The issue has been identified and a fix is being implemented.

2. monitoring Nov 03, 2024, 01:12 PM UTC

   A fix has been implemented and we are monitoring the results.

3. resolved Nov 04, 2024, 01:00 AM UTC

   This incident has been resolved.

Read the full incident report →