Blue Canvas incident

Intermittent issues for all customers

Critical Resolved View vendor source →

Blue Canvas experienced a critical incident on April 19, 2022 affecting Blue Canvas Web Application and Blue Canvas APIs and 1 more component, lasting 41m. The incident has been resolved; the full update timeline is below.

Started
Apr 19, 2022, 02:25 PM UTC
Resolved
Apr 19, 2022, 03:06 PM UTC
Duration
41m
Detected by Pingoru
Apr 19, 2022, 02:25 PM UTC

Affected components

Blue Canvas Web ApplicationBlue Canvas APIsMetadata Sync (Inbound)Metadata Deploy (Outbound)

Update timeline

  1. investigating Apr 19, 2022, 02:25 PM UTC

    We're experiencing intermittent errors for some of our customers and are currently looking into the issue. Errors may appear during page load and synchronization.

  2. investigating Apr 19, 2022, 02:33 PM UTC

    We are continuing to investigate this issue.

  3. identified Apr 19, 2022, 02:43 PM UTC

    The issue has been identified and a fix is being implemented.

  4. resolved Apr 19, 2022, 03:06 PM UTC

    This incident has been resolved. We identified an issue with memory handling on an internal cache server and responded by reverting to an old version of Blue Canvas. We're going to run a post mortem analysis to learn from and prevent issues like this in the future. Apologies for the interruption.