IRIS incident

Degraded performance to API Services

Major Resolved View vendor source →

IRIS experienced a major incident on December 2, 2023 affecting Manager and Europe and 1 more component, lasting 1d 19h. The incident has been resolved; the full update timeline is below.

Started
Dec 02, 2023, 04:36 PM UTC
Resolved
Dec 04, 2023, 12:26 PM UTC
Duration
1d 19h
Detected by Pingoru
Dec 02, 2023, 04:36 PM UTC

Affected components

ManagerEuropeNort America EastManager APISouth East Asia

Update timeline

  1. investigating Dec 02, 2023, 04:36 PM UTC

    We are currently experiencing a degraded performance with the API Service. Our engineering team are investigating, and we expect an update in the next hour. Services affected: Guest Mobile / Room / Web / Manager API Workaround: none Next update: 5.00pm GMT

  2. investigating Dec 02, 2023, 05:06 PM UTC

    We have no further information at this moment. The team continue to investigate the problem and as soon as an update becomes available we will update this thread. Workaround: [place details of any workaround available/ No workaround available] Next update: 18:00 GMT

  3. identified Dec 02, 2023, 05:28 PM UTC

    The engineering team have identified the cause of the issue with the web services and are currently working on implementing the resolution. Workaround: None at present Next update: 18:00

  4. monitoring Dec 02, 2023, 05:56 PM UTC

    We have now put in place a solution to resolve the issue caused by a problem with a certificate with one of our services. All services are now operational and should now return to normal. There may be some slow page loads while the cache rebuilds across all the regions but this should be completed in the next 20-30minutes. The team will continue to monitor closely for the next 24hrs.

  5. resolved Dec 04, 2023, 12:26 PM UTC

    This issue has now been resolved