Python Package Index incident

Infrastructure Outage

Critical Resolved View vendor source →

Python Package Index experienced a critical incident on December 13, 2024 affecting docs.python.org - Backends and speed.pypy.org and 1 more component, lasting 1h 25m. The incident has been resolved; the full update timeline is below.

Started
Dec 13, 2024, 01:44 PM UTC
Resolved
Dec 13, 2024, 03:09 PM UTC
Duration
1h 25m
Detected by Pingoru
Dec 13, 2024, 01:44 PM UTC

Affected components

docs.python.org - Backendsspeed.pypy.orgpython.org - Downloads Backendsbugs.python.orgwiki.python.org

Update timeline

  1. investigating Dec 13, 2024, 01:44 PM UTC

    We are currently investigating an infrastructure outage impacting python.org/downloads backends, docs.python.org backends, bugs.python.org backends, wiki.python.org backends, as well as other services.

  2. investigating Dec 13, 2024, 01:48 PM UTC

    We are continuing to investigate this issue.

  3. investigating Dec 13, 2024, 01:59 PM UTC

    We are continuing to investigate this issue.

  4. identified Dec 13, 2024, 02:00 PM UTC

    Private networking in our datacenter for these services is currently intermittent, we have opened a ticket with the provider requesting assistance.

  5. identified Dec 13, 2024, 02:23 PM UTC

    We are continuing to work on a fix for this issue.

  6. identified Dec 13, 2024, 02:45 PM UTC

    We are continuing to work on a fix for this issue.

  7. monitoring Dec 13, 2024, 02:58 PM UTC

    We have begun seeing recovery across all services as of 14:44 UTC, we are monitoring for stability and ensuring all services are healthy.

  8. resolved Dec 13, 2024, 03:09 PM UTC

    This incident has been resolved.