Boostlingo experienced a major incident on October 11, 2022 affecting Boostlingo Interpreter Portal and Boostlingo Group Rooms and 1 more component, lasting 1d 21h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 11, 2022, 03:33 PM UTC
We're experiencing an elevated level of API errors and are currently looking into the issue.
- investigating Oct 11, 2022, 06:31 PM UTC
We are continuing to investigate this issue.
- investigating Oct 11, 2022, 06:33 PM UTC
We are continuing to investigate this issue.
- investigating Oct 11, 2022, 08:14 PM UTC
Our team is continuing it's investigation of these issues. We are making progress in our investigation and at present we do not have an ETA available. Some guidelines to observe while we are working to resolve issues observed today - if you are unable to place a call, please wait for a couple of minutes before trying again. Same applies to app access.
- identified Oct 12, 2022, 12:24 AM UTC
The issue has been identified.
- investigating Oct 12, 2022, 12:40 AM UTC
We are continuing to investigate this issue.
- identified Oct 12, 2022, 12:45 AM UTC
The issue has been identified.
- identified Oct 12, 2022, 03:43 AM UTC
We experienced multiple application events today which led to service degradation for our US based customers during the day. We have traced this down to an unusually large number of requests which appear to be driven by the use of auto clickers by some interpreters. We are in the process of fixing this by serializing these requests to ensure that the web client does not get out of sync with the server. This fix will be deployed tonight. We will address circumventing the use of auto clickers in a subsequent hotfix. Additional performance related updates will also be made in the next few weeks. We sincerely apologize for this outage.
- monitoring Oct 12, 2022, 05:02 AM UTC
A fix has been implemented and we are monitoring the results.
- investigating Oct 12, 2022, 03:44 PM UTC
This morning we are experiencing errors that we are investigating.
- monitoring Oct 12, 2022, 06:00 PM UTC
Errors have subsided at this time and we are monitoring the situation closely.
- resolved Oct 13, 2022, 05:58 PM UTC
Release 4.8.2 was deployed last night and errors have subsided. The platform appears stable though, we will continue to monitor. We are closing incident at this time. Thank you for your patience and feedback.