Ghost Inspector incident

Test Scheduling Issue

Minor Resolved View vendor source →

Ghost Inspector experienced a minor incident on November 11, 2019 affecting Test Runner, lasting 1h 55m. The incident has been resolved; the full update timeline is below.

Started
Nov 11, 2019, 11:07 PM UTC
Resolved
Nov 12, 2019, 01:03 AM UTC
Duration
1h 55m
Detected by Pingoru
Nov 11, 2019, 11:07 PM UTC

Affected components

Test Runner

Update timeline

  1. investigating Nov 11, 2019, 11:07 PM UTC

    We're investigating issues coming up with scheduled tests and suites.

  2. identified Nov 12, 2019, 12:28 AM UTC

    An erroneous deployment to one of our test scheduler instances created issues with the tests and suites triggered by that instance. We've taken the instance offline and we are addressing the problem. Tests are being scheduled and completed properly system wide now. Most scheduled test runs were unaffected. Unfortunately test and suite runs that were triggered by this scheduling instance between 2019-11-11 22:28:00 UTC and 2019-11-11 23:10:00 UTC were not properly executed and stored. The records will not be reachable in the Ghost Inspector system. We will continue to monitor the situation and ensure it remains resolved.

  3. resolved Nov 12, 2019, 01:03 AM UTC

    This incident has been resolved.