Python Package Index incident

Database Storage Latencies

Major Resolved View vendor source →

Python Package Index experienced a major incident on October 17, 2023 affecting python.org - Backends and pypi.org - Backends, lasting 3h 11m. The incident has been resolved; the full update timeline is below.

Started
Oct 17, 2023, 07:32 PM UTC
Resolved
Oct 17, 2023, 10:44 PM UTC
Duration
3h 11m
Detected by Pingoru
Oct 17, 2023, 07:32 PM UTC

Affected components

python.org - Backendspypi.org - Backends

Update timeline

  1. investigating Oct 17, 2023, 07:32 PM UTC

    We are investigating and responding to widespread issues with databases in our infrastructure showing poor performance due to cloud block storage.

  2. identified Oct 17, 2023, 07:44 PM UTC

    A burst balance for our cloud storage disks that host our databases was exhausted. We are going to migrate to storage that will allow us to respond by adding more IOPS.

  3. resolved Oct 17, 2023, 10:44 PM UTC

    This incident has been resolved.