crates.io incident

Cargo error when downloading crates from our CDN

Major Resolved View vendor source →

crates.io experienced a major incident on September 11, 2020 affecting crates.io, lasting 4d 20h. The incident has been resolved; the full update timeline is below.

Started
Sep 11, 2020, 12:37 AM UTC
Resolved
Sep 15, 2020, 09:11 PM UTC
Duration
4d 20h
Detected by Pingoru
Sep 11, 2020, 12:37 AM UTC

Affected components

crates.io

Update timeline

  1. investigating Sep 11, 2020, 12:37 AM UTC

    We received reports that Cargo is failing to download packages from static.crates.io, with the error message "failed to get 200 response from URL, got 206". Our understanding is that this is affecting just a few geographical regions in of US, and that this is an issue with our CDN provider. We're in contact with their support team to address the issue.

  2. investigating Sep 11, 2020, 10:06 AM UTC

    The situation is slowly improving, as over the past 6 hours only 14 requests were affected by the issue according to our logs, across the US and Asia. We're continuing to monitor the situation, and we're in contact with our CDN provider to get it fixed permanently.

  3. monitoring Sep 11, 2020, 02:16 PM UTC

    There are no more invalid responses showing up in our CDN logs for the past 3 hours. We'll continue to monitor the situation and work with our CDN provider to make sure the issue is permanently addressed.

  4. monitoring Sep 11, 2020, 11:26 PM UTC

    In the past 12 hours no invalid response was sent from our CDN, according to our response logs. We're continuing to monitor the issue, and our CDN provider is rolling out a permanent fix to the problem.

  5. monitoring Sep 13, 2020, 01:47 PM UTC

    In the past 26 hours no invalid response was sent from our CDN, according to our response logs. We're continuing to monitor the issue, and our CDN provider is rolling out a permanent fix to the problem.

  6. resolved Sep 15, 2020, 09:11 PM UTC

    Since our last update no invalid response was sent from our CDN, according to our response logs. We're marking this incident as resolved, and we're working with our CDN provider to avoid similar problems in the future.