Blacksmith incident

Delay in picking up jobs

Major Resolved

Blacksmith experienced a major incident on May 27, 2026 affecting Blacksmith Managed Runners (eu-central ARM) and Blacksmith Managed Runners (eu-central x86) and 1 more component, lasting 5h 16m. The incident has been resolved; the full update timeline is below.

Started
May 27, 2026, 07:01 PM UTC
Resolved
May 28, 2026, 12:18 AM UTC
Duration
5h 16m
Detected by Pingoru
May 27, 2026, 07:01 PM UTC

Affected components

Blacksmith Managed Runners (eu-central ARM)Blacksmith Managed Runners (eu-central x86)Blacksmith Managed Runners (us-west ARM)Blacksmith Managed Runners (us-west x86)Blacksmith Managed Runners (eu-west x86)Blacksmith Managed Runners (us-central MacOS)

Update timeline

  1. investigating May 27, 2026, 07:01 PM UTC

    We are currently investigating this incident.

  2. identified May 27, 2026, 07:56 PM UTC

    We've deployed mitigations and are observing improvements.

  3. monitoring May 27, 2026, 08:24 PM UTC

    Continuing to monitor improvements from deployment.

  4. monitoring May 27, 2026, 10:35 PM UTC

    We're continuing to monitor the situation. There's still a slight delay in jobs, but cancelling and rerunning the jobs should resolve the issue.

  5. resolved May 28, 2026, 12:18 AM UTC

    This incident has been resolved.