Blue Canvas incident

Files tab not working in deployment requests

Minor Resolved View vendor source →

Blue Canvas experienced a minor incident on February 13, 2025 affecting Blue Canvas Web Application, lasting 25d 17h. The incident has been resolved; the full update timeline is below.

Started
Feb 13, 2025, 10:01 PM UTC
Resolved
Mar 11, 2025, 03:41 PM UTC
Duration
25d 17h
Detected by Pingoru
Feb 13, 2025, 10:01 PM UTC

Affected components

Blue Canvas Web Application

Update timeline

  1. investigating Feb 13, 2025, 10:01 PM UTC

    The frontend is not updating properly when rendering the file tab. This is due to a significant boost in background jobs on our git server. We are investigating the root cause. Deployments are working, but we understand it is hard to see what is going on without being able to inspect the files.

  2. monitoring Feb 14, 2025, 11:28 AM UTC

    The queues seem to be cleared up and everything is working as expected. We've had to clear some of the queues. We have not yet identified the exact job that was delaying the system. However we've found some great optimizations and working on a long term fix for those meanwhile we are monitoring the situation. If your deployment is still showing as "Nothing to merge from" please use "Discard results and validate again" in the top right dropdown of the deployment request view.

  3. resolved Mar 11, 2025, 03:41 PM UTC

    The incident has been resolved since February 15th, we have been monitoring ever since but the incident has not been properly updated.