Technolutions incident
Increased demands on RTC infrastructure for webinars
Technolutions experienced a notice incident on March 19, 2020 affecting Slate, lasting 7d. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Mar 19, 2020, 02:22 PM UTC
We are continuing to monitor increased demands on our RTC infrastructure, which provides the backbone for webinars in Slate. We quadrupled capacity last night, and we're preparing for additional increases to capacity and additional sharding to support the thousands of webinars being hosted through Slate per week right now.
- monitoring Mar 19, 2020, 08:26 PM UTC
We will be launching overnight a new WebSocket control plane that will replace the existing REST interface. This will enable us to forego long-polling in the client and should significantly increase our capacity capabilities. There should be no observable client-side impact, and all control plane and media relay connections will continue to be routed securely over port 443. We will continue to monitor this infrastructure, as we're continuing to see unprecedented utilization of webinar services in Slate.
- resolved Mar 26, 2020, 03:06 PM UTC
We've been observing good stability and performance this week following additional improvements made over the weekend and at the beginning of the week. We'll be publishing an interface and feature update to test and production environments later today that further expands and enhances the capabilities of Share. We will proceed with closing this advisory at this time, and we will continue to monitor all systems and infrastructure.