Intermittent 502 and Service Unavailable Errors for a subset of customers in ANZ Region on 2025A

Update timeline

1. investigating Jun 18, 2025, 02:55 AM UTC

   We’re currently investigating ongoing 502 and Service Unavailable errors affecting some environments following the recent Mainline update (Snapshot 2025A (380)). These errors are currently observed in Financials and Supply Chain functions. They are linked to exceptions triggered by specific user actions, which cause the affected service to shut down. TechnologyOne is actively remediating as incidents occur. Mitigations have been implemented to reduce the impact while we identify the exception pattern and develop a permanent fix. We will provide an update as soon as more information is available.

2. identified Jun 18, 2025, 06:59 AM UTC

   We’ve identified the exception pattern causing intermittent 502 and Service Unavailable errors in Financials and Supply Chain functions. A permanent fix is now under development, and mitigations remain in place to reduce impact in the meantime. We’ll provide further updates as the fix progresses.

3. monitoring Jun 18, 2025, 11:51 PM UTC

   Mitigations have been applied and are currently being monitored to ensure stability and reduce further impact. A permanent fix remains in development. We’ll provide an update once the fix is available or if anything changes. Thank You for your patience.

4. monitoring Jun 19, 2025, 11:28 PM UTC

   The permanent fix for the intermittent 502 and Service Unavailable errors in Financials and Supply Chain functions will be released to Fastline this evening 2025A (394). The fix will be included in Mainline as part of the scheduled update next weekend. You can view the deployment schedule here - https://technologyonecorp365.sharepoint.com/:x:/s/SP_KT43N9/EeB5USzWQRRKhWmWvKnzamsBriu6Zd7TgMHnrwONTJQN9w?e=zVJ6FX We’ll continue to monitor and will provide confirmation once the Mainline update is complete.

5. monitoring Jun 25, 2025, 11:11 PM UTC

   The permanent fix for the intermittent 502 and Service Unavailable errors in Financials and Supply Chain functions will be deployed to Mainline as Snapshot 2025A (394). according to the planned schedule. Schedule can be found here: https://technologyonecorp365.sharepoint.com/:x:/s/SP_KT43N9/EeB5USzWQRRKhWmWvKnzamsBriu6Zd7TgMHnrwONTJQN9w?e=zVJ6FX We will continue to monitor through Monday, 30 June, to ensure stability. Further updates will be provided if required.

6. resolved Jun 30, 2025, 07:16 AM UTC

   The permanent fix for the intermittent 502 and Service Unavailable errors in Financials and Supply Chain functions was deployed to Mainline Snapshot 2025A (394). Following monitoring through to Monday, 30 June, no further issues have been observed. This incident is now considered resolved. Thank you for your patience while we worked to address the issue.

7. postmortem Jul 28, 2025, 01:21 AM UTC

   Issue Summary: On June 18 at 10:17 AM, customers reported intermittent 502 and service unavailable errors within Financials and Supply Chain functions in CiA. Root Cause: A recursive loop was found to occur during the initialization process under certain conditions. Corrective actions: High-traffic requests were isolated to a separate processing path, and the affected servers were recycled to restore normal service. Preventative Measures: Software changes implemented to remove the recursive looping.