Mural incident
Users getting prompted to leave the network to continue
Mural experienced a major incident on March 6, 2024 affecting Authentication and Realtime collaboration, lasting 1h 2m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Mar 06, 2024, 05:56 PM UTC
We have received several notifications that users were prompted to leave the network in order to continue, causing them to be automatically signed out from the Mural app. We have now detected the root cause and applied a fix, so we are now monitoring its effects.
- resolved Mar 06, 2024, 06:59 PM UTC
This incident has been resolved.
- postmortem Mar 14, 2024, 01:49 PM UTC
**What happened:** At 17:10 CET on March 6th, 2024, we updated the IP allowlisting settings for one of our Enterprise customers. The list of IP addresses contained ranges used by a 3rd party cloud security provider, which prevented a subset of customers from accessing Mural. We started to receive reports of access issues and immediately engaged our incident task force to investigate. The incorrect IP address configuration was quickly identified as the cause of the access issues. We rolled back the change and full access was restored at 17:50 CET. **What we’ve done to avoid this happening again:** We have implemented additional checks on IP address restrictions, whilst our engineers work on product enhancements to prevent this issue from re-occurring.