Galaxy Project experienced a major incident on May 17, 2019 affecting Webserver 1 and Webserver 2, lasting 2h 54m. The incident has been resolved; the full update timeline is below.
Affected components
Webserver 1Webserver 2
Update timeline
- identified May 17, 2019, 06:25 PM UTC
Some jobs (execution of tools) on usegalaxy.org have failed because Galaxy has accidentally exceeded our storage quota. Processes that should have been cleaning up older data have not been running properly. We have disabled tool execution and are currently using multiple methods to decrease our usage, and expect to be able to re-enable tool execution by 5:00 PM EDT (UTC -0400).
- monitoring May 17, 2019, 07:56 PM UTC
Jobs are running again and we are monitoring for errors.
- resolved May 17, 2019, 09:19 PM UTC
Jobs are running normally.