Farm HPC cluster incident
Farm Jobs stuck in SUSPENDED, COMPLETING states
Resolved after 39 minutes, affecting Login and Storage, on September 26, 2024.
A reboot of nas-4-1 cleared up the NFS mount issue, allowing the jobs stuck in COMPLETING to actually complete. Admins are investigating ways to mitigate this issue.
Affected components
Update timeline
- identified Sep 26, 2024, 04:58 PM UTC
Farm's nas-4-1 has been identified as having NFS issues and requires a reboot. This will block logins for users with home directories that reside there. Any in-progress jobs will pause, and resume after the reboot.
- resolved Sep 26, 2024, 05:38 PM UTC
A reboot of nas-4-1 cleared up the NFS mount issue, allowing the jobs stuck in COMPLETING to actually complete. Admins are investigating ways to mitigate this issue.
Your product runs on more than Farm HPC cluster
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services