Galaxy Project experienced a critical incident on July 2, 2019 affecting TTS and Main Tool Shed, lasting 5h 18m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 02, 2019, 09:19 AM UTC
The Galaxy (Main) Tool Shed is currently unreachable. This appears to be due to network issues at Penn State, but we are investigating the issue. This also affects the Test Tool Shed.
- identified Jul 02, 2019, 10:41 AM UTC
Primary psu.edu DNS servers ns1.psu.edu and ns2.psu.edu appear to be offline, preventing the toolshed.g2.bx.psu.edu domain from resolving in some cases. The alternate nameserver psu-ns.acns.msu.edu is operational but not all recursing DNS resolvers properly fail over requests to working nameservers upon failure.
- resolved Jul 02, 2019, 02:37 PM UTC
Penn State DNS services have been fixed and the Tool Shed has returned to service.