Happeo incident

Channel Outage: Unable to add new users to Channels or create new Channels

Critical Resolved View vendor source →

Happeo experienced a critical incident on August 21, 2024 affecting Channels, lasting 17h 24m. The incident has been resolved; the full update timeline is below.

Started
Aug 21, 2024, 01:20 PM UTC
Resolved
Aug 22, 2024, 06:45 AM UTC
Duration
17h 24m
Detected by Pingoru
Aug 21, 2024, 01:20 PM UTC

Affected components

Channels

Update timeline

  1. investigating Aug 21, 2024, 01:20 PM UTC

    We are investigating an issue where users that have been added to a Channel are unable to access the Channel. Older members (users added before 21-08-2024) should not experience any issues when trying to access their content.

  2. investigating Aug 21, 2024, 01:49 PM UTC

    We are continuing to investigate an issue that is preventing users from adding new users to Channels or creating new Channels. Older members (users added before 21-08-2024) should not experience any issues when trying to access their content. Existing Channels will continue to work as normal with posts being able to be made. We will share any updates we have here as soon as possible. We apologize for any inconvenience this may cause.

  3. identified Aug 21, 2024, 03:33 PM UTC

    We have identified the problem and are working on a fix.

  4. monitoring Aug 21, 2024, 04:10 PM UTC

    We have implemented a fix that has resolved the issue. You are now able to add users to Channels again, and newly created Channels will now appear as normally. Should you have attempted to create a Channel several times in the previous couple of hours, there is a chance you will find that all those attempts will actually have generated the Channels, and you may have duplicates in your system which can be removed.

  5. resolved Aug 22, 2024, 06:45 AM UTC

    This incident has been resolved.