Exalate incident
Nodes down due to routing incident in core infrastructure
Exalate experienced a critical incident on September 22, 2024 affecting Hosting platform, lasting 2d 16h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 22, 2024, 07:40 PM UTC
Due to a routing problem, a subset of nodes (currently about 80%) are unreachable. Root causing is ongoing and status updates will be provided every 2 hours.
- identified Sep 22, 2024, 08:11 PM UTC
A containment has been agreed and is now being implemented.
- monitoring Sep 22, 2024, 08:41 PM UTC
The fix has been implemented, we'll monitoring the environment for an additional day.
- investigating Sep 23, 2024, 10:57 AM UTC
We have identified an issue where some nodes are unreachable due to a routing problem. We have started to investigate the issue and will provide further updates shortly.
- identified Sep 23, 2024, 11:35 AM UTC
A fix is now being implemented.
- identified Sep 23, 2024, 02:28 PM UTC
We are still addressing the issue affecting some of our nodes. As of now, 50% of the affected nodes are back online. Our team is working diligently to restore full functionality as soon as possible.
- monitoring Sep 23, 2024, 04:55 PM UTC
All nodes are now back online. We will continue monitoring and further updates will be provided.
- resolved Sep 25, 2024, 12:09 PM UTC
The issue affecting Exalate Cloud has been resolved. We are currently preparing a post-mortem report, which will be shared early next week. Thank you for your patience and understanding.
- postmortem Apr 01, 2026, 04:12 AM UTC
timeout