Stream experienced a major incident on December 8, 2021 affecting us-east, lasting 5h 22m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 08, 2021, 07:20 AM UTC
We're experiencing an elevated level of API errors and are currently looking into the issue. This issue affects one shard only in our us-east region.
- identified Dec 08, 2021, 08:55 AM UTC
The issue has been identified and a fix is being implemented. A temporary remediation has been put in place to mitigate the ongoing issue.
- monitoring Dec 08, 2021, 09:02 AM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Dec 08, 2021, 11:04 AM UTC
The issue of this morning propagated to an additional component of our infrastructure intended to dispatch messages to the end users via websocket protocol. Our team tried to mitigate the issue and the problem seems to be resolved now. We are still monitoring the situation closely.
- resolved Dec 08, 2021, 12:43 PM UTC
The incident has been resolved. A post-mortem will follow.