BombBomb incident

Team functionality is temporarily unavailable for some users

Notice Resolved View vendor source →

BombBomb experienced a notice incident on August 3, 2022 affecting Web Application, lasting 9h 15m. The incident has been resolved; the full update timeline is below.

Started
Aug 03, 2022, 07:47 PM UTC
Resolved
Aug 04, 2022, 05:03 AM UTC
Duration
9h 15m
Detected by Pingoru
Aug 03, 2022, 07:47 PM UTC

Affected components

Web Application

Update timeline

  1. identified Aug 03, 2022, 06:05 PM UTC

    We have identified 227 teams that have been dismantled. The individuals associated with these teams still have access to their BombBomb accounts, however, they do not have access to their team's members, content, and analytics. Our engineers have identified the issue and expect a full recovery in rebuilding these teams in the next few hours.

  2. identified Aug 03, 2022, 06:19 PM UTC

    We have a full solution in progress to fix this issue. We estimate a full recovery by 2:30 MST.

  3. identified Aug 03, 2022, 07:47 PM UTC

    Our engineers are releasing a fix to re-associate members back to teams in the next few minutes. We will then release a fix to re-associate shared video content back to members, we estimate this portion to be complete by 2:30 MST.

  4. identified Aug 03, 2022, 08:21 PM UTC

    We have completed the first step in resolving this issue. Members have been re-associated with their teams.

  5. identified Aug 03, 2022, 09:00 PM UTC

    Our engineers are implementing the second step in resolving this issue, which will re-associate shared video content back to members. We estimate one hour for completion of this step.

  6. monitoring Aug 03, 2022, 10:31 PM UTC

    Our engineers have successfully re-associated 90% of shared content to members of teams. We will continue this work and monitor what's been completed.

  7. identified Aug 03, 2022, 11:30 PM UTC

    Our engineers have turned off Prompt and Automation sends for impacted users temporarily to help with the resolution of this issue.

  8. identified Aug 04, 2022, 02:28 AM UTC

    Our engineers are working towards sending out the automated and schedule emails, and Prompt sends from earlier today.

  9. resolved Aug 04, 2022, 05:03 AM UTC

    Prompt sends are turned back on for impacted customers. Automations will be slightly delayed.