Element incident

Element One message processing outage

Critical Resolved View vendor source →

Element experienced a critical incident on November 13, 2023 affecting Element One, lasting 14h 59m. The incident has been resolved; the full update timeline is below.

Started
Nov 13, 2023, 08:16 PM UTC
Resolved
Nov 14, 2023, 11:15 AM UTC
Duration
14h 59m
Detected by Pingoru
Nov 13, 2023, 08:16 PM UTC

Affected components

Element One

Update timeline

  1. investigating Nov 13, 2023, 08:16 PM UTC

    We've identified a fault where the one.ems.host / Element One homeserver is not handling message traffic. We are working on a fix.

  2. monitoring Nov 13, 2023, 08:41 PM UTC

    We believe that this has now been mostly restored and are monitoring for any degradations over the next few hours.

  3. identified Nov 13, 2023, 10:09 PM UTC

    The issue has resurfaced and we're currently working on a more permanent fix.

  4. monitoring Nov 13, 2023, 11:04 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Nov 14, 2023, 11:15 AM UTC

    This incident has been resolved.