Hivebrite incident

All likes disappeared from before yesterday 10AM CET on all environments

Notice Resolved View vendor source →

Hivebrite experienced a notice incident on June 23, 2023 affecting European production servers and US production servers and 1 more component, lasting 7h 21m. The incident has been resolved; the full update timeline is below.

Started
Jun 23, 2023, 02:36 PM UTC
Resolved
Jun 23, 2023, 09:57 PM UTC
Duration
7h 21m
Detected by Pingoru
Jun 23, 2023, 02:36 PM UTC

Affected components

European production serversUS production serversApac production serversEuropean sandbox serversUS sandbox serversSwitzerland production servers

Update timeline

  1. investigating Jun 23, 2023, 02:36 PM UTC

    All likes disappeared since yesterday 10AM CET on all environments. We are working on getting the data back as soon as possible. We apologize for the inconvenience and will let you know as soon as we have news.

  2. identified Jun 23, 2023, 06:21 PM UTC

    We have identified the cause of the incident and are working on the resolution. Updates will be provided as progress is made. Thank you for your understanding.

  3. identified Jun 23, 2023, 07:44 PM UTC

    We are continuing to work on a fix for this issue.

  4. identified Jun 23, 2023, 08:16 PM UTC

    We are starting to recover the data. Everything is back on 1/6 servers. Thank you for your patience. We will keep you posted for the other environments.

  5. identified Jun 23, 2023, 08:52 PM UTC

    We are halfway through to recover the data. Everything is back on 3/6 servers. Thank you for your patience. We will keep you posted for the other environments.

  6. monitoring Jun 23, 2023, 09:22 PM UTC

    We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.

  7. resolved Jun 23, 2023, 09:57 PM UTC

    The incident has been resolved. All data has been restored properly to all environments. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.