Ibbü incident

No more incoming conversations + panel conversation loading issue

Critical Resolved View vendor source →

Ibbü experienced a critical incident on November 18, 2020 affecting Chat and Conversation Panel and 1 more component, lasting 5h 31m. The incident has been resolved; the full update timeline is below.

Started
Nov 18, 2020, 10:05 AM UTC
Resolved
Nov 18, 2020, 03:36 PM UTC
Duration
5h 31m
Detected by Pingoru
Nov 18, 2020, 10:05 AM UTC

Affected components

ChatConversation PanelNotifications

Update timeline

  1. investigating Nov 18, 2020, 10:05 AM UTC

    We have noticed a problem on the platform since 10:55am (UTC+1). The panel conversation no longer loads properly for the advisors. Engagement notifications are no longer offered on the visitor side. Our technical team is mobilised to solve this problem as soon as possible.

  2. investigating Nov 18, 2020, 10:19 AM UTC

    We are recording an unexpected significant charge on our databases. Restoration actions have been taken to mitigate the load and actions to restore the platform are underway.

  3. investigating Nov 18, 2020, 10:34 AM UTC

    The problem is still there. We are continuing our investigations to restore the situation and thank you in advance for your patience.

  4. investigating Nov 18, 2020, 10:52 AM UTC

    We are currently failing over our database on another server. We switched off the visitor engagement during the operation. We will get back to you in 15min to give you an update (if the problem is not solved by then).

  5. monitoring Nov 18, 2020, 11:04 AM UTC

    Following our actions, we are seeing a gradual return to a normal situation. The experts can log on again. Visitors can again start conversations. We continue to monitor the platform.

  6. resolved Nov 18, 2020, 03:36 PM UTC

    We close the incident after a monitoring period. The cause of the incident is identified. This incident has nothing to do with an increase in traffic and we are confident for the next peaks of activity to come (Black Friday, Christmas period). Thank you again for your patience and understanding.