Ghost Inspector experienced a minor incident on November 16, 2021 affecting Test Runner, lasting 1h 36m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 16, 2021, 06:18 PM UTC
We are currently investigating a slow down in running Chrome tests on our system. Tests are still completed but may take slightly longer to begin executing.
- identified Nov 16, 2021, 06:43 PM UTC
We've identified the source of the slow down. Test running is coming back up to speed and working through the queue of Chrome tests. We'll follow up with some additional detail on the issue and the fixes we'll be planning to address it in the future. We expect the queue to be 100% caught up by 12pm PT today.
- monitoring Nov 16, 2021, 07:01 PM UTC
The Chrome queue is 100% caught up and test runs should be completing in their normal timeframe again. We are in the process of implementing fixes and creating additional monitors to prevent this type of slow down in the future.
- resolved Nov 16, 2021, 07:55 PM UTC
Test running capacity is stable. We'll continue to monitor test running capacity and will update this ticket with additional details.