Rocket.Chat incident

EUC1 Database cluster down

Minor Resolved View vendor source →

Rocket.Chat experienced a minor incident on April 17, 2024 affecting Rocket.Chat, lasting 1h 57m. The incident has been resolved; the full update timeline is below.

Started
Apr 17, 2024, 07:18 AM UTC
Resolved
Apr 17, 2024, 09:15 AM UTC
Duration
1h 57m
Detected by Pingoru
Apr 17, 2024, 07:18 AM UTC

Affected components

Rocket.Chat

Update timeline

  1. identified Apr 17, 2024, 07:18 AM UTC

    Initial status of Identified

  2. identified Apr 17, 2024, 07:43 AM UTC

    Database nodes crashed, causing them to reboot. We are now slowly recovering as the nodes are coming back up.

  3. identified Apr 17, 2024, 07:49 AM UTC

    One of the nodes is still down. We are working on getting it back up. But workspaces will now start recovering.

  4. resolved Apr 17, 2024, 09:15 AM UTC

    All issues resolved