Farm HPC cluster incident

nas-6-0 currently offline

Major Resolved View vendor source →

Farm HPC cluster experienced a major incident on October 19, 2023 affecting Storage, lasting 6h 29m. The incident has been resolved; the full update timeline is below.

Started
Oct 19, 2023, 03:42 PM UTC
Resolved
Oct 19, 2023, 10:11 PM UTC
Duration
6h 29m
Detected by Pingoru
Oct 19, 2023, 03:42 PM UTC

Affected components

Storage

Update timeline

  1. investigating Oct 19, 2023, 03:42 PM UTC

    nas-6-0 has stopped serving data, we are investigating.

  2. monitoring Oct 19, 2023, 04:44 PM UTC

    Due to the nature of the glitch, we rebooted nas-6-0 and it is now correctly serving data. We will keep monitoring it to ensure it continues to work correctly.

  3. resolved Oct 19, 2023, 10:11 PM UTC

    This incident has been resolved.