Higher Logic incident
CSS Styling Issues for Online Community Sites
Higher Logic experienced a minor incident on May 7, 2024 affecting Community, lasting 1h 21m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 07, 2024, 07:14 PM UTC
We are currently investigating this issue.
- monitoring May 07, 2024, 08:09 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved May 07, 2024, 08:36 PM UTC
This incident has been resolved.
- postmortem May 09, 2024, 08:00 PM UTC
## Date: May 7, 2024 ### What Happened? During our scheduled Production release on May 7, 2024, customers encountered a CSS issue that caused many pages across the site to become unusable. This was due to an unexpected issue when updating which version of Bootstrap that our sites should be using. The issue was resolved once the release was completed. ### Root Cause The root cause of the issue has been narrowed down to releasing an updated version of our Global Configuration in production. Configuration values pointing to the Bootstrap source file were removed as part of the release process prior to the code being pushed out to production tenants. This meant that the older code in production was attempting to read from configuration values that no longer existed, and therefore the source URL for Bootstrap was incorrect. As soon as the code was fully released the sites began pointing to the new value in our Global Configuration and the issue was resolved. ### Corrective Actions * Document the standard operating procedure for adding, removing, and updating global configuration values * Document the possible issues if the process is not followed * Train the development team on the new standard operating procedure. This will be done prior to the next Global Configuration release * Long-term corrective action will be to remove the possibility of human error in this release process