Firebolt incident

Unable to start Engines on FB 2.0

Critical Resolved View vendor source →

Firebolt experienced a critical incident on November 14, 2024 affecting Engines, lasting 23m. The incident has been resolved; the full update timeline is below.

Started
Nov 14, 2024, 07:46 PM UTC
Resolved
Nov 14, 2024, 08:10 PM UTC
Duration
23m
Detected by Pingoru
Nov 14, 2024, 07:46 PM UTC

Affected components

Engines

Update timeline

  1. investigating Nov 14, 2024, 07:46 PM UTC

    We are currently experiencing an unplanned service outage affecting all regions. As of 18:26 UTC, you may encounter difficulties starting engines in our FB 2.0 environment. Our engineering team is actively working to resolve the issue as quickly as possible. We will provide updates on our Statuspage at least every 15 minutes. Thank you for your patience and understanding.

  2. investigating Nov 14, 2024, 08:02 PM UTC

    We are still experiencing the issue, and continuing to work on a fix Updated Impact: - Engines are unable to start. - Engines are unable to stop with Autostop and remain in the "Running" state, even when no queries are executed. - Insert commands are failing on currently running engines. We continue to look into this with the highest priority.

  3. resolved Nov 14, 2024, 08:10 PM UTC

    The issue was resolved at 20:03 UTC. We experienced an outage in engine operations, which was addressed by reverting a recent network change. Services are now fully operational. Please reach out if you experience any further issues.