Umbrellar experienced a critical incident on October 29, 2025 affecting Australia East and Australia Southeast, lasting 8h 42m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Oct 29, 2025, 06:19 PM UTC
We want to inform you that we are currently aware of an issue affecting Azure Front Door, which may be impacting your service availability or performance. Microsoft has acknowledged the incident and is actively working on a resolution. You can follow their updates directly via https://azure.status.microsoft/en-us/status. We are closely monitoring the situation and will keep you informed as we learn more. Your experience is important to us, and we appreciate your patience and understanding.
- identified Oct 29, 2025, 07:39 PM UTC
At this stage, Microsoft anticipate full mitigation within the next four hours as they continue to recover nodes. This means we expect recovery to happen by 12:20PM on 30 October 2025. We will provide another update on our progress within two hours, or sooner if warranted
- identified Oct 29, 2025, 11:25 PM UTC
Microsoft has deployed its last known good configuration and recovery is progressing. They are actively restoring nodes and rerouting traffic through healthy systems. While improvements are being seen, some requests may still hit unhealthy nodes, causing intermittent failures or reduced availability. The recovery process involves reloading configurations and rebalancing traffic across a large fleet. This is being done gradually to maintain stability and avoid overload as dependent services come back online. Microsoft expects full mitigation by 12:40PM NZDT on 30 October 2025, and will communicate if recovery completes sooner. Customer configuration changes remain temporarily blocked by Microsoft to prevent interference with recovery efforts. They will notify when this restriction is lifted.
- identified Oct 29, 2025, 11:30 PM UTC
We are continuing to work on a fix for this issue.
- resolved Oct 30, 2025, 12:43 AM UTC
We’re pleased to confirm that the recent Microsoft Azure service disruption has now been fully resolved. All affected Azure services are now operating normally, and recovery activities have been completed across all impacted regions. Our own monitoring also confirms that your hosted environments are stable, accessible, and performing as expected. The outage was linked to a configuration change within Azure Front Door (AFD) that caused DNS and connectivity issues across several regions. Microsoft promptly rolled back the change, restored normal operation, and is now conducting a full review of the event.