SalesScreen experienced a major incident on March 26, 2024 affecting Web and Mobile and 1 more component, lasting 6h 9m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 26, 2024, 12:14 PM UTC
We are investigating an issue with adding reports from the web dashboard
- monitoring Mar 26, 2024, 12:23 PM UTC
We have identified the issue and deployed a fix. We are monitoring to confirm that the issue has been fully resolved.
- monitoring Mar 26, 2024, 02:52 PM UTC
The underlying issue has been identified as a messaging component that had reached maximum capacity. This means reports were successfully stored, but an error message would be displayed as the messaging component could not be reached. Furthermore, all functionality that subscribes to report events stopped working. As of 13:15, all new report events have been generated as expected. We are currently working on regenerating events for reports added between 12:00 and 13:15.
- monitoring Mar 26, 2024, 02:52 PM UTC
We are continuing to monitor for any further issues.
- resolved Mar 26, 2024, 06:24 PM UTC
All events for the affected reports have now been re-processed.