Mural incident

Some users are unable to access their murals

Major Resolved View vendor source →

Mural experienced a major incident on June 14, 2022 affecting Website, lasting 4h 26m. The incident has been resolved; the full update timeline is below.

Started
Jun 14, 2022, 09:59 AM UTC
Resolved
Jun 14, 2022, 02:26 PM UTC
Duration
4h 26m
Detected by Pingoru
Jun 14, 2022, 09:59 AM UTC

Affected components

Website

Update timeline

  1. investigating Jun 14, 2022, 09:59 AM UTC

    We are currently investigating this issue, but only certain murals seem to be affected at this time. We recommend refreshing your browser's cache and trying again whilst we investigate. Thank you for your patience in this matter!

  2. investigating Jun 14, 2022, 10:10 AM UTC

    We are seeing some disruptions in our system and we're currently investigating on the back end. We appreciate your patience and apologise for any inconveniences.

  3. investigating Jun 14, 2022, 10:11 AM UTC

    We are seeing some disruptions in our system and we're currently investigating on the back end. We appreciate your patience and apologise for any inconveniences.

  4. identified Jun 14, 2022, 11:09 AM UTC

    We have detected the cause of the outage and are working on reestablishing the service as soon as possible. We appreciate your collaboration in this matter.

  5. monitoring Jun 14, 2022, 12:53 PM UTC

    Our cloud provider experienced a service disruption which impacted a limited number of MURAL users, preventing murals from loading correctly. Our cloud provider has fixed the issue on their side and we have implemented a change to mitigate the impact of this disruption. The issue should now be resolved. We are continuing to monitor system stability for any ongoing issues. If you are continuing to experience issues accessing your murals, please contact [email protected].

  6. resolved Jun 14, 2022, 02:26 PM UTC

    This incident has been resolved.

  7. postmortem Aug 23, 2022, 04:36 PM UTC

    **What happened?** On June 14th at 07:48 UTC, we started to receive isolated reports of MURAL users in Europe being unable to access their murals. At 08:48 UTC we confirmed this was an issue affecting a significant proportion of MURAL users and escalated this to our incident response team to commence investigations. At 10:25 UTC our cloud provider confirmed there was an issue with their portal \(see [https://status.azure.com/en-gb/status/history/](https://status.azure.com/en-gb/status/history/) for more details\). This was confirmed to be the root cause of the issue affecting MURAL users. At 12:16 UTC, in collaboration with our cloud provider, we successfully updated our connection to the Azure portal. By 12:50 UTC full connectivity and service in MURAL had been restored. ‌ **Summary** This incident resulted in 5 hours 2 mins of downtime. No data from prior to the outage was lost during this time.