Resolved after 152 days, affecting Slurm, on April 24, 2025.
Farm's slurmdbd is having intermittent issues. If you see an error like below, it means the problem has occurred again, and we will restart slurmdbd to bring it back into service. """sacctmgr: error: _open_persist_conn: failed to open persistent connection to host:monitoring-ib:6819: Connection timed out sacctmgr: error: Sending PersistInit msg: Connection timed out""" We have a support case open with SchedMD and will update this issue as we learn more.
Affected components
Update timeline
- investigating Apr 24, 2025, 12:22 AM UTC
Farm's slurmdbd is having intermittent issues. If you see an error like below, it means the problem has occurred again, and we will restart slurmdbd to bring it back into service. """sacctmgr: error: _open_persist_conn: failed to open persistent connection to host:monitoring-ib:6819: Connection timed out sacctmgr: error: Sending PersistInit msg: Connection timed out""" We have a support case open with SchedMD and will update this issue as we learn more.
- resolved Sep 23, 2025, 12:42 AM UTC
This incident has been resolved.
Your product runs on more than Farm HPC cluster
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services