Discord Extreme List incident

Infrastructure Outage

Critical Resolved View vendor source →

Discord Extreme List experienced a critical incident on December 29, 2020 affecting Website and API and 1 more component, lasting 3h 27m. The incident has been resolved; the full update timeline is below.

Started
Dec 29, 2020, 07:27 AM UTC
Resolved
Dec 29, 2020, 10:55 AM UTC
Duration
3h 27m
Detected by Pingoru
Dec 29, 2020, 07:27 AM UTC

Affected components

WebsiteAPIEtcd clusterBotMongoDB ReplicasetRedis Sentinels

Update timeline

  1. investigating Dec 29, 2020, 07:27 AM UTC

    Our infrastructure appears to be experiencing a major outage. We are investigating. We are also in the process of switching to new servers to resolve the recent reliability issues.

  2. identified Dec 29, 2020, 07:48 AM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Dec 29, 2020, 10:27 AM UTC

    Infra is up (on some new servers!) but Mongo is down and the websites are inaccessible. We are still working on fixing the issues.

  4. identified Dec 29, 2020, 10:32 AM UTC

    Our websites and DB are back up! We're still working on bringing our blog and API back up.

  5. resolved Dec 29, 2020, 10:55 AM UTC

    The blog and API are back up! This incident is now resolved.