Blacksmith incident

Jobs not getting picked up

Major Resolved

Blacksmith experienced a major incident on August 6, 2026 affecting EU Central (eu-central ARM) and EU Central (eu-central x86) and 1 more component, lasting 1h 34m. The incident has been resolved; the full update timeline is below.

Started
Aug 06, 2026, 01:18 AM UTC
Resolved
Aug 06, 2026, 02:53 AM UTC
Duration
1h 34m
Detected by Pingoru
Aug 06, 2026, 01:18 AM UTC

Affected components

EU Central (eu-central ARM)EU Central (eu-central x86)US West (us-west ARM)US West (us-west x86)EU West (eu-west x86)Actions CacheUS Central (us-central MacOS)WebsiteIncremental Docker Builders (eu-central Storage Cluster)Incremental Docker Builders (us-west Storage Cluster)

Update timeline

  1. investigating Aug 06, 2026, 01:18 AM UTC

    We're currently experiencing an outage of our control plane. GitHub job adoption and execution are affected, as well as dashboard access.

  2. identified Aug 06, 2026, 01:36 AM UTC

    We've mitigated the root cause and jobs are resuming to run. Some jobs may still be delayed to start as we catch up with the job backlog.

  3. monitoring Aug 06, 2026, 01:51 AM UTC

    Jobs adoption has recovered and are operational.

  4. monitoring Aug 06, 2026, 02:11 AM UTC

    There is still a delay in job adoption times as we continue to recover.

  5. monitoring Aug 06, 2026, 02:45 AM UTC

    Job adoption is now fully operational.

  6. resolved Aug 06, 2026, 02:53 AM UTC

    This incident has been resolved.