TrekkSoft incident

Channel Manager booking processing issue

Major Resolved View vendor source →

TrekkSoft experienced a major incident on August 11, 2020 affecting ExperienceBank - Channel Manager, lasting 4h 33m. The incident has been resolved; the full update timeline is below.

Started
Aug 11, 2020, 07:41 AM UTC
Resolved
Aug 11, 2020, 12:15 PM UTC
Duration
4h 33m
Detected by Pingoru
Aug 11, 2020, 07:41 AM UTC

Affected components

ExperienceBank - Channel Manager

Update timeline

  1. investigating Aug 11, 2020, 07:41 AM UTC

    We are experiencing issues with bookings coming in through our channel manager: TrekkConnect / ExperienceBank. A proportion of these bookings are currently not being processed. The main affected channels are Get Your Guide and Viator. Our developers are looking into finding the root cause of this issue. We will keep you updated and apologize for the inconvenience.

  2. resolved Aug 11, 2020, 12:15 PM UTC

    Issue Resolved: The Experience/TrekkConnect channel manager is working again as expected. Bookings that were made during this partial outage were stored and are now being carried over to the booking system.

  3. postmortem Aug 12, 2020, 12:16 PM UTC

    Root cause: Memory shortage on one of the servers caused bookings from OTAs not to be created on the internal booking system. What happened: Bookings from OTAs were taken by the channel manager but were not translated into bookings on TrekkSoft. What we did: Our developers pinpointed the specific services that were affected and were not performing correctly. These services were restarted and this solved the issue. The consequences: Most bookings taken during the down time were created on TrekkSoft after the issue was resolved. Only bookings for activities that already took place, or have meanwhile run out of seats, were not created on TrekkSoft. Providers receive email notifications about these failed bookings and should check their email inboxes. Refunds for failed bookings through the OTAs should be made by providers through the OTAs. We apologize for the inconvenience.