Cleo Integration Cloud incident

Cleo Integration Cloud: CIC Cockpit latency in job visibility

Minor Resolved View vendor source →

Cleo Integration Cloud experienced a minor incident on July 31, 2023 affecting CIC Cockpit, lasting 15h 2m. The incident has been resolved; the full update timeline is below.

Started
Jul 31, 2023, 03:41 PM UTC
Resolved
Aug 01, 2023, 06:44 AM UTC
Duration
15h 2m
Detected by Pingoru
Jul 31, 2023, 03:41 PM UTC

Affected components

CIC Cockpit

Update timeline

  1. investigating Jul 31, 2023, 03:41 PM UTC

    Cleo engineers have been notified of latency in job visibility which may affect the experience of some customers while using CIC Cockpit. Our team is actively investigating.

  2. investigating Jul 31, 2023, 04:42 PM UTC

    At this time, some customers may experience intermittent latency in Messages/Jobs visibility in CIC Cockpit. Note: At this time, inbound and outbound transactions are processing as normal. Cleo engineers are continuing to investigate and will provide periodic updates.

  3. investigating Jul 31, 2023, 05:59 PM UTC

    Customers may still be experiencing brief delays in the Messages/Jobs view in CIC Cockpit without impact to ongoing integration processes. Cleo engineers are continuing to investigate and will provide periodic updates.

  4. investigating Jul 31, 2023, 07:13 PM UTC

    A subset of customers may be experiencing delays in the Messages/Jobs visibility in CIC Cockpit. Cleo engineers are continuing to investigate and will provide periodic updates.

  5. investigating Jul 31, 2023, 08:32 PM UTC

    Cleo engineers are continuing to investigate and will provide periodic updates.

  6. investigating Jul 31, 2023, 09:34 PM UTC

    At this time, some customers may experience intermittent latency in Messages/Jobs visibility in CIC Cockpit. Note: At this time, inbound and outbound transactions are processing as normal. Cleo engineers are continuing to investigate and will provide periodic updates.

  7. identified Jul 31, 2023, 10:22 PM UTC

    Cleo engineers have identified the underlying cause and are working on immediate corrective actions to CIC Cockpit. We will continue to provide periodic updates.

  8. identified Jul 31, 2023, 11:06 PM UTC

    Cleo engineers have applied a fix and are closely monitoring CIC Cockpit to confirm restoration of normal performance and visibility. "

  9. monitoring Aug 01, 2023, 12:05 AM UTC

    Our team is continuing to monitor CIC to ensure there is no recurrence of the previous condition. We will continue to provide periodic updates within the next two hours

  10. monitoring Aug 01, 2023, 02:12 AM UTC

    Our team is continuing to monitor CIC to ensure there is no recurrence of the previous condition.

  11. monitoring Aug 01, 2023, 04:32 AM UTC

    Our team is continuing to monitor CIC to ensure there is no recurrence of the previous condition.

  12. investigating Aug 01, 2023, 05:50 AM UTC

    Customers may still be experiencing delays in the Jobs view in CIC Cockpit without impact to ongoing integration processes. Cleo engineers are continuing to investigate and will provide periodic updates.

  13. monitoring Aug 01, 2023, 06:25 AM UTC

    Cleo engineers have applied a fix. Cleo is closely monitoring CIC to ensure that all services are performing as normal. For any delayed Jobs visibility in CIC Cockpit, rest assured that we will perform all required recovery activities in the next 24-36 hours.

  14. resolved Aug 01, 2023, 06:44 AM UTC

    All Cleo Integration Cloud services appear to be performing as normal and are confirmed through monitoring. The visibility of Jobs from July 31st 16:00 CDT to August 1st 01:00 CDT will be restored by Cleo Engineers through the next 24 to 36 hours. Cleo will provide an RCA through the Services Update section in CIC within the next 5 business days.