Dremio experienced a minor incident on September 28, 2023 affecting Site Availability, lasting 8h 27m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 28, 2023, 08:06 PM UTC
Network connectivity for new Dremio Cloud Engines (EC2 instances) in the single availability zone use-az2 in the US-EAST-1 region is degraded. Existing engine instances should not be impacted. The latest information from AWS can be found at https://health.aws.amazon.com/health/status. We will provide updates from AWS as we have them.
- identified Sep 28, 2023, 08:11 PM UTC
The issue has been identified and a fix is being implemented.
- identified Sep 28, 2023, 08:48 PM UTC
The latest update from AWS (Sep 28 1:43 PM PDT) indicates they are continuing to work on the problem with the single zone in US-EAST-1.
- identified Sep 28, 2023, 09:21 PM UTC
The latest update from AWS indicates they continue working on resolving error rates and increased delays, and that we should see improvement over the next 1-2 hours. Our synthetic testing in US-EAST-1 use1-az2 has begun reporting success. Dremio Cloud engines in the impacted Availability Zone may still experience degradation until fully resolved by AWS.
- resolved Sep 29, 2023, 04:33 AM UTC
AWS has resolved the issues with service in US-EAST-1. Dremio Cloud Engines (EC2 instances) should be fully operational again across all regions. We will continue to monitor for any additional impact. The latest information from AWS can be found at https://health.aws.amazon.com/health/status.