Orchestry experienced a major incident on July 30, 2024 affecting Web Application and API, lasting 9h 1m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 30, 2024, 01:26 PM UTC
We are currently investigating timeouts when connecting to Orchestry. This appears to be due to global Microsoft Azure networking infrastructure issues.
- identified Jul 30, 2024, 02:43 PM UTC
Orchestry's APIs and Web App are currently affected by the global Azure Networking outage. We are monitoring the situation and will report any updates when it improves. See https://azure.status.microsoft/en-us/status for Azure status.
- monitoring Jul 30, 2024, 05:53 PM UTC
Microsoft has implemented network configuration changes and have performed failovers to fix the global Azure networking issue. Orchestry's service availability has returned to normal at this time. We will continue to monitor the situation and provide an update when it is resolved.
- resolved Jul 30, 2024, 10:28 PM UTC
This incident has been resolved.
- postmortem Jul 31, 2024, 03:45 PM UTC
**Postmortem: Degraded Networking and Timeouts Due to Global Azure Outage - July 30, 2024** **Overview:** Between approximately at 11:45 UTC and 19:43 UTC on 30 July 2024, Orchestry customers may have experienced issues connecting to Orchestry API and Web App services globally. The issue was due to an underlying [global Azure networking outage](https://azure.status.microsoft/en-us/status/history/) - Tracking ID: KTY1-HW8. Unfortunately, due to the global impact of the networking issue, all regions were affected and regional failovers were unavailable as a mitigation strategy.