Lightspeed Systems incident
[11026] Lightspeed Filter™ (Relay) - Intermittent Interface Errors in Management Console
Lightspeed Systems experienced a minor incident on August 25, 2022 affecting Lightspeed Filter™, lasting 5d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Aug 25, 2022, 06:05 PM UTC
We are currently investigating an issue with the Lightspeed Filter™ admin interface. Users may experience slow browsing and potential error messages when navigating the management console. We will report back when we know more. We appreciate your patience as we work to resolve this issue. Please continue to monitor status.lightspeedsystems.com for additional updates.
- monitoring Aug 25, 2022, 07:58 PM UTC
We are continuing to monitor the service issue affecting Lightspeed Filter™. Thank you for your patience and understanding while we investigate this issue. Please continue to monitor status.lightspeedsystems.com for additional updates.
- monitoring Aug 25, 2022, 08:10 PM UTC
We are continuing to monitor the service issue affecting Lightspeed Filter™. Thank you for your patience and understanding while we investigate this issue. Please continue to monitor status.lightspeedsystems.com for additional updates.
- investigating Aug 26, 2022, 01:31 PM UTC
We are currently investigating issues with the with the Lightspeed Filter™ admin interface. Users may experience intermittent slow page loads. The team will report back as we find more information. Your patience is greatly appreciated. Please continue to monitor status.lightspeedsystems.com for additional updates.
- monitoring Aug 26, 2022, 01:37 PM UTC
Please disregard the previous message. Lightspeed Filter™ is still operating as expected as we monitor its progress.
- monitoring Aug 26, 2022, 03:59 PM UTC
From 8:37CDT -10:53CDT Filter customers may have experienced slow page loads and intermittent page errors. The cause has been found/addressed & the issue appears to be resolved. We are currently monitoring the situation and will provide more info as it's received. Thank you for your continued patience.
- investigating Aug 26, 2022, 05:33 PM UTC
Our team identified some underlying issues with our hosting/service provider that are contributing to Lightspeed Filter™ disruptions. We are currently working with both internal and external stakeholders to remedy the issues as quickly as possible. At this time, users may experience slow browsing and potential error messages when navigating the management console. All filtering remains operational. We will report back as events unfold.
- investigating Aug 26, 2022, 06:49 PM UTC
We are continuing to investigate this issue.
- investigating Aug 26, 2022, 07:17 PM UTC
We continue to work with our hosting/service provider to remedy the issue we've uncovered. At this time, users may experience slow browsing, potential error messages when navigating the management console, and intermittent issues with devices having a delay in receiving filtering rule changes. This delay averages around 5-10 minutes. Filtering remains functional, though devices that have failed to retrieve their specific user's filtering rules will use their existing rules. If the device has never received filtering rules, it will use a preloaded CIPA compliant ruleset. After a device restarts, this delay may cause the device to not immediately retrieve the organizational rules you have set. The default preloaded CIPA compliant rules will be used until successfully retrieved.
- monitoring Aug 29, 2022, 03:49 PM UTC
Following up from our messages last week, we have resolved issues with Lightspeed Filter services. Both UI access and policy retrieval are working as expected. We are continuing to work with our 3rd party service provider to ensure stability during this back-to-school period. Our engineers are actively monitoring the service to mitigate any further issues. We will continue to update you with any new information. Thank you for your patience while our teams worked to resolve this issue. Please continue to monitor https://status.lightspeedsystems.com for additional updates.
- monitoring Aug 29, 2022, 09:59 PM UTC
All services have been restored and we are continuing to work with our 3rd-party service provider to ensure stability during this back-to-school period. Our engineers are actively monitoring the service for any further issues.
- resolved Aug 30, 2022, 08:04 PM UTC
The service disruptions affecting the Lightspeed Filter UI and policy retrieval were resolved at 12 pm CST on August 29th, 2022. No additional errors have been seen and we will continue to monitor. Thank you for your patience and understanding while we investigated and resolved this issue. Please continue to monitor https://status.lightspeedsystems.com for additional updates.