Cleo Integration Cloud incident
Cleo Integration Cloud: CIC Engine, Protocol Engine - All inbound and outbound protocols
Cleo Integration Cloud experienced a major incident on November 4, 2024 affecting Cleo Integration Cloud - Protocol Engine, lasting 3h 19m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 04, 2024, 03:25 PM UTC
Cleo Engineers were alerted by internal monitoring to a condition that is affecting inbound and outbound connectivity for all communication protocols. Currently outbound transactions are being queued by CIC and inbound transactions are producing failures to trading partners.
- identified Nov 04, 2024, 04:16 PM UTC
Cleo engineers have made a fix that has now allowed 33% of inbound and outbound traffic to process successfully. Cleo engineers are continuing to make changes to allow the remaining traffic to process successfully.
- identified Nov 04, 2024, 05:21 PM UTC
Based on the previous change outbound delays are down to fifteen minutes. For inbound, approximately 75% of inbound connections continue to be impacted. However, based on best practices, trading partners would have attempted retries and those retries have a 25% chance of successful execution, meaning after roughly four retry attempts, inbound traffic will get through. Cleo engineers are continuing to make adjustments to facilitate the successful processing of the remaining traffic. We will continue to provide periodic updates.
- monitoring Nov 04, 2024, 05:57 PM UTC
Service has been restored and inbound and outbound communications are working as expected. Cleo engineers will continue to closely monitor CIC to ensure there is no recurrence of the previous condition.
- resolved Nov 04, 2024, 06:44 PM UTC
All inbound and outbound traffic is confirmed to be performing as normal through monitoring. Cleo will provide an official RCA through the Services Update section in CIC within the next 5 business days.