Firebolt incident

starting & stopping engines takes long time.

Major Resolved View vendor source →

Firebolt experienced a major incident on June 8, 2022 affecting Engines, lasting 2h 50m. The incident has been resolved; the full update timeline is below.

Started
Jun 08, 2022, 08:18 AM UTC
Resolved
Jun 08, 2022, 11:08 AM UTC
Duration
2h 50m
Detected by Pingoru
Jun 08, 2022, 08:18 AM UTC

Affected components

Engines

Update timeline

  1. identified Jun 08, 2022, 08:18 AM UTC

    The issue is back, and Starting/Stopping engines may not work properly. We are continuing to investigate this issue.

  2. identified Jun 08, 2022, 08:36 AM UTC

    We are deploying a fix, and the issue should be resolved soon.

  3. identified Jun 08, 2022, 09:11 AM UTC

    We are running some tests on staging to make sure the fix resolved the issue.

  4. monitoring Jun 08, 2022, 09:37 AM UTC

    The fix deployed to production, and engines can be started and stopped again.

  5. resolved Jun 08, 2022, 11:08 AM UTC

    The issue resolved and the system is back to normal state.