Resolved after 1 hour 24 minutes, affecting high,low and bmh,bmm and 1 more, on December 20, 2023.
All stragglers have been brought back into the fold and slurm is able to communicate with the nodes and start jobs.
Affected components
Update timeline
- identified Dec 20, 2023, 05:26 PM UTC
A failed Ethernet switch in Farm has broken internal communications required for DNS, DHCP, Slurm, etc. Admins are working on getting a temporary replacement installed to restore communications. No new jobs will be able to start until the replacement is online.
- monitoring Dec 20, 2023, 06:40 PM UTC
The switch has been replaced and most hosts are now able to talk as necessary. We are still working on bringing the stragglers back into the fold.
- resolved Dec 20, 2023, 06:51 PM UTC
All stragglers have been brought back into the fold and slurm is able to communicate with the nodes and start jobs.
Your product runs on more than Farm HPC cluster
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services