Farm HPC cluster incident

Farm's nas-12-3 having disk issues

Resolved after 2 days 4 hours, affecting Storage, on June 28, 2026.

resolved Jun 30, 2026, 09:49 PM UTC

nas-12-3 managed to rebuild data onto the new drives over the weekend, so it is no longer teetering on the brink of catastrophic data loss. At this point it is fully back in service and will be closely monitored for additional issues.

Started
Jun 28, 2026, 05:25 PM UTC
Resolved
Jun 30, 2026, 09:49 PM UTC
Duration
2d 4h
Detected by Pingoru
Jun 28, 2026, 05:25 PM UTC

Affected components

Storage

Update timeline

  1. identified Jun 28, 2026, 05:25 PM UTC

    Farm's nas-12-3 is having critical disk issues and is currently unavailable. This is impacting all users with home directories still in the adamgrp legacy free-tier storage as well as the expired emoniergrp and spatial03 shares. Admins are evaluating options.

  2. resolved Jun 30, 2026, 09:49 PM UTC

    nas-12-3 managed to rebuild data onto the new drives over the weekend, so it is no longer teetering on the brink of catastrophic data loss. At this point it is fully back in service and will be closely monitored for additional issues.

Your product runs on more than Farm HPC cluster

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →