crates.io incident

Broken download links

Major Resolved View vendor source →

crates.io experienced a major incident on July 20, 2023 affecting crates.io, lasting 1h 58m. The incident has been resolved; the full update timeline is below.

Started
Jul 20, 2023, 12:17 PM UTC
Resolved
Jul 20, 2023, 02:15 PM UTC
Duration
1h 58m
Detected by Pingoru
Jul 20, 2023, 12:17 PM UTC

Affected components

crates.io

Update timeline

  1. monitoring Jul 20, 2023, 12:59 PM UTC

    After a deployment we noticed an elevated number of download requests, that were caused by crates.io generating broken download URLs and cargo retrying those downloads again and again. We have rolled back the deployment to fix the issue in production. The bug is already identified and we are working on a long-term fix.

  2. resolved Jul 20, 2023, 02:15 PM UTC

    The bugfix has been merged and deployed to production. We have adjusted our test suite to reduce the chances of this issue appearing again in the future.