Endless Group incident

MySQL Outage

Critical Resolved View vendor source →

Endless Group experienced a critical incident on August 3, 2020 affecting MySQL, lasting 12h 31m. The incident has been resolved; the full update timeline is below.

Started
Aug 03, 2020, 05:15 AM UTC
Resolved
Aug 03, 2020, 05:47 PM UTC
Duration
12h 31m
Detected by Pingoru
Aug 03, 2020, 05:15 AM UTC

Affected components

MySQL

Update timeline

  1. investigating Aug 03, 2020, 08:10 AM UTC

    Our MySQL instance seems to have crashed and is not restarting as intended. We are investigating this issue and hope to be able to have it up and running again soon.

  2. monitoring Aug 03, 2020, 04:11 PM UTC

    The issue has been identified to be a configuration that was reset without our knowledge during a recent system update. The configuration has been fixed and MySQL is now starting again. Please expect degraded performance as many sites are attempting to reconnect to the database now that is is online again.

  3. resolved Aug 03, 2020, 05:47 PM UTC

    This incident has been resolved.