Blacksmith incident

Major outage with our caching infrastructure and our website

Major Resolved

Blacksmith experienced a major incident on September 9, 2026 affecting Incremental Docker Builders (eu-central Storage Cluster) and Incremental Docker Builders (us-west Storage Cluster) and 1 more component, lasting 1h 20m. The incident has been resolved; the full update timeline is below.

Started
Sep 09, 2026, 04:46 PM UTC
Resolved
Sep 09, 2026, 06:06 PM UTC
Duration
1h 20m
Detected by Pingoru
Sep 09, 2026, 04:46 PM UTC

Affected components

Incremental Docker Builders (eu-central Storage Cluster)Incremental Docker Builders (us-west Storage Cluster)Docker Container Cache (eu-central Storage Cluster)Docker Container Cache (us-west Storage Cluster)Sticky Disks (eu-central Storage Cluster)Sticky Disks (us-west Storage Cluster)Sticky Disks (eu-west Storage Cluster)Incremental Docker Builders (eu-west Storage Cluster)Docker Container Cache (eu-west Storage Cluster)Dashboard

Update timeline

  1. investigating Sep 09, 2026, 05:14 PM UTC

    We are currently experiencing a major outage with both our caching infrastructure and our dashboards. These components are affected across all regions. We are investigating the issue and will provide an update soon.

  2. monitoring Sep 09, 2026, 05:21 PM UTC

    We are seeing recovery of our caching infrastructure and our dashboard. We will continue to monitor this situation closely.

  3. resolved Sep 09, 2026, 06:06 PM UTC

    This incident has been resolved.