Matrix incident

Matrix.org Homeserver Outage

Critical Resolved View vendor source →

Matrix experienced a critical incident on April 22, 2024 affecting Synapse and Outbound federation, lasting 3h 27m. The incident has been resolved; the full update timeline is below.

Started
Apr 22, 2024, 09:04 AM UTC
Resolved
Apr 22, 2024, 12:32 PM UTC
Duration
3h 27m
Detected by Pingoru
Apr 22, 2024, 09:04 AM UTC

Affected components

SynapseOutbound federation

Update timeline

  1. investigating Apr 22, 2024, 09:04 AM UTC

    The Matrix.org homeserver is currently failing to persist events, meaning users can't send events or receive them over federation We are working to remedy the problem.

  2. investigating Apr 22, 2024, 09:17 AM UTC

    The failure on Matrix.org has expanded and now users may be unable to sync (receive messages).

  3. monitoring Apr 22, 2024, 10:43 AM UTC

    The Matrix.org homeserver is running slowly, particularly when it comes to sending events, as it handles the backlog that built up whilst it was down.

  4. investigating Apr 22, 2024, 10:53 AM UTC

    The Matrix.org homeserver is once again inaccessible from clients. We are looking into the problem.

  5. monitoring Apr 22, 2024, 11:05 AM UTC

    The Matrix.org homeserver is now accessible from clients again. Event send performance is slightly degraded for the time being.

  6. resolved Apr 22, 2024, 12:32 PM UTC

    Performance seems to have recovered. Sorry for the trouble and thanks for your patience.