Firebolt incident

Inability to Start Engines

Minor Resolved View vendor source →

Firebolt experienced a minor incident on March 4, 2024 affecting Engines, lasting 2h 25m. The incident has been resolved; the full update timeline is below.

Started
Mar 04, 2024, 06:12 PM UTC
Resolved
Mar 04, 2024, 08:38 PM UTC
Duration
2h 25m
Detected by Pingoru
Mar 04, 2024, 06:12 PM UTC

Affected components

Engines

Update timeline

  1. investigating Mar 04, 2024, 06:12 PM UTC

    We’re experiencing an issue with starting engines that affects us-east-1 since 4:49pm UTC, Starting engines will fail until the issue is resolved. If you have already started an engine and are experiencing unusual timings please reach out to support. Our engineers are working to resolve the issue as soon as possible. We will be updating the Status page page with new information at the latest every 30 minutes.

  2. investigating Mar 04, 2024, 06:20 PM UTC

    We have come to learn the issue is not bound to us-east-1 region only, but is unfortunately impacting all regions. The only impact we know of for now is the inability to start engines. Already running engines should not be impacted.

  3. investigating Mar 04, 2024, 06:54 PM UTC

    We are continuing to investigate the issue.

  4. identified Mar 04, 2024, 07:35 PM UTC

    We have identified the issue and are working towards restoring the functionality.

  5. monitoring Mar 04, 2024, 07:46 PM UTC

    We have fixed the issue. Engines are now able to start. We are still working on restoring the engines that are currently in "Starting up" state.

  6. resolved Mar 04, 2024, 08:38 PM UTC

    Service is now fully restored.