Bizzabo incident
Service Degradation - Dashboard Latency & Registration Delays
Bizzabo experienced a minor incident on April 19, 2022 affecting Organizer Dashboard and API and 1 more component, lasting 6d 20h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Apr 19, 2022, 03:20 PM UTC
We are investigating reports of latency which is primarily impacting organizer dashboards. We will update on our progress as soon as possible.
- investigating Apr 19, 2022, 04:59 PM UTC
In order to mitigate the current latency issues, we’ve temporarily disabled a capability in your Event Experience OS. The report tiles on dashboards will be turned off, but those found under “Analytics” will not be affected. We will restore these services as quickly as possible. If you have any questions, please open a ticket with Bizzabo Support.
- investigating Apr 19, 2022, 09:01 PM UTC
We are continuing to investigate latency impacting dashboards, registrations, and post-registration actions (specifically the receipt of confirmation emails). We will provide additional updates as they become available.
- investigating Apr 20, 2022, 04:20 PM UTC
R&D continues to work on immediate improvements to the current dashboard latency, and are working on several options to bring about a full remedy to this incident. A detailed update will be posted by the end of the day.
- identified Apr 20, 2022, 10:07 PM UTC
Our Engineering team has identified a path forward to resolve the latency issues. We are finalizing the details of the plan and will communicate them tomorrow morning. We apologize for the delay in sharing out the full plan, but we are working diligently to ensure that we resolve every possible iteration of this issue. Once we have finalized all details of the steps we will take, we will communicate them here by tomorrow morning (EST).
- identified Apr 21, 2022, 02:17 PM UTC
We continue to work with our engineering team to provide both a comprehensive timeline for resolution, as well as a clear outline of the expected impact on product functionality during that process. A formal letter will be emailed to all users, with an update posted here once it is ready. Your continued patience is greatly appreciated as we work to bring about both a full resolution and detailed communication around next steps.
- identified Apr 22, 2022, 12:35 AM UTC
To fully address the latency issues we have been experiencing, we will need to implement a window for platform maintenance, beginning Saturday, 4/23, at 10 pm EST, until Sunday, 4/24, at 5 pm EST. During this time, the Bizzabo platform will be partially unavailable and both the dashboard and registration will not be functional. We apologize for any inconvenience this may cause. Should you need any assistance or information around this maintenance event, please reach out to Bizzabo Support.
- monitoring Apr 24, 2022, 09:05 PM UTC
With the successful maintenance window complete, we are setting this status to "Monitoring" until the system processes the items that were generated during the maintenance window. This may take several hours and we will mark this Resolved once this is caught up.
- monitoring Apr 24, 2022, 09:06 PM UTC
We are continuing to monitor for any further issues.
- resolved Apr 26, 2022, 12:13 PM UTC
We appreciate your patience as we worked through this incident and apologize for the inconvenience it caused. We are marking this issue as resolved. Should you have any questions or need additional assistance, please reach out to Bizzabo Support. A formal Root Cause Analysis is being worked on and once ready, will be available via Bizzabo Support or your Customer Success Manager.