Semaphore incident
Delays when checking out GitHub repos via SSH
Semaphore experienced a minor incident on May 20, 2026 affecting Semaphore, lasting 6h 47m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified May 20, 2026, 08:44 AM UTC
We identified slow communication between Semaphore jobs and GitHub. We are continuing to work with our upstream provider to resolve this. For impacted jobs, please replace the normal checkout command with the following: retry --times 5 "timeout 40 bash -lc 'source ~/.toolbox/toolbox; checkout'" And afterwards, use cd to change the directory to the cloned repository (replace with your project).
- monitoring May 20, 2026, 12:48 PM UTC
A fix has been implemented and we are monitoring the results.
- identified May 20, 2026, 01:59 PM UTC
We identified slow GitHub operations related to problems with the network, and we deployed a fix to re-route those operations to a healthier server. Some HTTPS operations started to fail because of that. To disable the fix, you should use the command: sudo sed -i 's/^\([0-9].*github\.com\)/#\1/' /etc/hosts And to re-enable, you can use: sudo sed -i 's/^#\([0-9].*github\.com\)/\1/' /etc/hosts
- monitoring May 20, 2026, 03:02 PM UTC
A fix has been implemented, and everything should be back to normal. The previously shared snippets can be removed.
- resolved May 20, 2026, 03:32 PM UTC
This incident has been resolved.