Dremio incident

Unable to start Azure-based project engines in Dremio Cloud

Major Resolved View vendor source →

Dremio experienced a major incident on February 27, 2024 affecting Dremio Cloud - US and Dremio Cloud - Europe, lasting 7h 31m. The incident has been resolved; the full update timeline is below.

Started
Feb 27, 2024, 12:58 AM UTC
Resolved
Feb 27, 2024, 08:30 AM UTC
Duration
7h 31m
Detected by Pingoru
Feb 27, 2024, 12:58 AM UTC

Affected components

Dremio Cloud - USDremio Cloud - Europe

Update timeline

  1. investigating Feb 27, 2024, 12:58 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We are currently investigating the issue. Expect updates every 30 minutes.

  2. identified Feb 27, 2024, 01:38 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on a fix. We will provide another update by 6:45 PM PT.

  3. identified Feb 27, 2024, 02:30 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on a fix. We will provide another update by 7:45 PM PT.

  4. identified Feb 27, 2024, 03:32 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on rolling out a fix. We will provide another update by 8:45 PM PT.

  5. identified Feb 27, 2024, 04:41 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are continuing to work on rolling out a fix. We will provide another update by 9:45 PM PT.

  6. identified Feb 27, 2024, 05:44 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are continuing to work on rolling out a fix. We will provide another update by 10:45 PM PT.

  7. identified Feb 27, 2024, 06:26 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have verified a fix and are working on rolling out the fix to production environments. We will provide another update by 11:15 PM PT.

  8. identified Feb 27, 2024, 07:08 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have verified a fix and are continuing to roll out the fix to production environments. We will provide another update by 11:45 PM PT.

  9. identified Feb 27, 2024, 07:44 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have rolled out the fix to Dremio Cloud EU and are continuing to roll out the fix to Dremio Cloud US. We will provide another update by 12:15 AM PT.

  10. identified Feb 27, 2024, 08:19 AM UTC

    Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have rolled out the fix to Dremio Cloud EU and are completing the roll out of the fix to Dremio Cloud US. We will provide another update by 12:45 AM PT.

  11. resolved Feb 27, 2024, 08:30 AM UTC

    We have rolled out the fix to all Dremio Cloud environments and have verified engines are coming up for Azure-based projects. We apologize for any inconvenience this incident may have caused.