Buildkite incident

Increased error rate for pipeline uploads

Minor Resolved View vendor source →

Buildkite experienced a minor incident on September 29, 2025 affecting Job Queue, lasting 38m. The incident has been resolved; the full update timeline is below.

Started
Sep 29, 2025, 06:06 AM UTC
Resolved
Sep 29, 2025, 06:45 AM UTC
Duration
38m
Detected by Pingoru
Sep 29, 2025, 06:06 AM UTC

Affected components

Job Queue

Update timeline

  1. investigating Sep 29, 2025, 06:06 AM UTC

    We've been alerted to an increased error rate for pipeline uploads, and are investigating the cause.

  2. monitoring Sep 29, 2025, 06:23 AM UTC

    We have identified a faulty deploy, and have performed a rollback to resolve the issue.

  3. resolved Sep 29, 2025, 06:45 AM UTC

    A handful of customers were unable to upload pipelines containing steps with soft-failure configurations, resulting in failed builds. This bug has since been rolled back. Pipeline uploads are now working again as expected.