Happydance experienced a major incident on April 1, 2025 affecting Microsoft Azure, lasting 1d 20h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Apr 01, 2025, 11:12 AM UTC
We are currently investigating an issue with Azures US1 Central Network effecting customers. We will provide more information as we identify the cause.
- investigating Apr 01, 2025, 11:16 AM UTC
Failover for all US1 customers has commenced.
- investigating Apr 01, 2025, 11:35 AM UTC
We have successfully migrated all US1 customers to our failover region US West 1
- monitoring Apr 01, 2025, 11:35 AM UTC
We will continue to monitor the US1 Region and move customers back once stable
- monitoring Apr 01, 2025, 12:24 PM UTC
We are continuing to see issues with the US network as a whole and are trying to mitigate these for our customers
- monitoring Apr 01, 2025, 04:21 PM UTC
We are holding off putting customers back to US central until we get confirmation from Azure that there is no further impact on our services. Initial Investigation looks to be a network hardware failure in their central datacenter.
- monitoring Apr 02, 2025, 01:22 PM UTC
All websites have now been restored to Central US (US1). Services are operating normally, and we continue to monitor the server closely to ensure stability.
- resolved Apr 03, 2025, 07:24 AM UTC
This incident has been resolved.