Ionic Framework incident
Appflow iOS builds intermittently failing
Ionic Framework experienced a minor incident on May 8, 2024 affecting Ionic Appflow Build Service, lasting 2h 23m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 08, 2024, 02:11 PM UTC
Beginning around 5:00 am ET, degraded performance of the iOS build runners has been identified. iOS builds may be intermittently failing. We are working on investigating the issue and should have more details available shortly. Thank you for your patience.
- monitoring May 08, 2024, 02:31 PM UTC
A fix has been implemented and we currently working on identifying the root cause. We expect that new iOS builds should no longer fail. Thank you for your patience.
- resolved May 08, 2024, 04:34 PM UTC
This incident has been resolved.
- postmortem May 08, 2024, 08:54 PM UTC
On May 8th, the Appflow service experienced degraded performance from 3 AM EDT to 9:45 AM EDT. This was caused by an upgrade in our cloud hypervisor software specifically for Mac virtual machines running on Intel CPU Architecture. Late evening May 7th, 2024, the Appflow team rolled out an upgrade to the Mac Hypervisor software on Intel Mac machines in the Appflow Build Cloud. This change introduced a new limitation to network requests within Mac virtual machines which subsequently caused timeouts on external requests within build executions. As a result, all builds running on the affected instances would fail or timeout. On May 8th, 2024 at approximately 9:45 AM EDT, we rolled back all of the affected instances with the older version of the software to resolve the introduced problem.