Blue Canvas incident

Queue Overloaded

Blue Canvas is currently experiencing a minor incident affecting Metadata Deploy (Outbound), which began 3h ago. The vendor's full update timeline is below.

Started
Jun 11, 2026, 03:37 PM UTC
Resolved
Ongoing
Duration
● 3h 6m
Detected by Pingoru
Jun 11, 2026, 03:37 PM UTC

Affected components

Metadata Deploy (Outbound)

Update timeline

  1. identified Jun 11, 2026, 03:37 PM UTC

    A queue that processes background jobs has become overloaded, and is affecting the creation of deployment requests. We're currently working to resolve this issue.

  2. monitoring Jun 11, 2026, 04:23 PM UTC

    We identified the root cause. One of our queued jobs, scheduled to run every 10 seconds, began taking several minutes to complete. These long-running jobs accumulated and consumed all available worker capacity. We've deployed two fixes: - Concurrency limit, only one instance of this job can run at a time, preventing pile-up. - Rewritten algorithm, the job now resolves in ~1 second instead of minutes. We're continuing to monitor.