Circle CI incident

Machine and Remote Docker jobs are delayed

Minor Resolved View vendor source →

Circle CI experienced a minor incident on November 17, 2025 affecting Machine Jobs, lasting 4h 4m. The incident has been resolved; the full update timeline is below.

Started
Nov 17, 2025, 04:18 PM UTC
Resolved
Nov 17, 2025, 08:23 PM UTC
Duration
4h 4m
Detected by Pingoru
Nov 17, 2025, 04:18 PM UTC

Affected components

Machine Jobs

Update timeline

  1. investigating Nov 17, 2025, 04:18 PM UTC

    We are investigating Machine and Remote Docker delays. We are working on resolving this as quickly as possible. All jobs will continue to run normally after the delay. Thank you for your patience.

  2. identified Nov 17, 2025, 05:00 PM UTC

    We have identified the cause of Machine and Remote Docker delays. We are making changes which we expect to reduce the delays. All jobs will continue to run normally after the delay, and we expect the delay will decrease with time. Thank you for your patience.

  3. identified Nov 17, 2025, 06:46 PM UTC

    We are actively adding additional capacity to reduce job start delays for Linux , AMD and Remote Docker resource classes. Current improvements show average wait times are now under one minute for most jobs, with some customers waiting up to 6 minutes for jobs using these resources. . Current Status: - Linux, AMD and Remote Docker jobs: Wait times improving as we expand capacity, delays up to 6 minutes - Docker, Mac, Windows, and Android jobs: Operating normally without delays Our team is continuing to deploy additional resources to fully eliminate the remaining delays. We expect continued improvement over the next hour as this expanded capacity comes online. We appreciate your patience as we optimize our infrastructure to meet current demand. Next Update: Within 30 minutes or when normal operation is restored.

  4. monitoring Nov 17, 2025, 07:51 PM UTC

    We continue to see reductions in average wait times for customers requesting Linux, AMD, and Remote Docker resource classes, with maximum delays now reduced to under 3 minutes. Current Status: - Linux, AMD and Remote Docker jobs: Wait times continue to improve, maximum delays of just under 3 minutes - Docker, Mac, Windows, and Android jobs: Operating normally without delays Additional capacity continues to come online, and we expect further improvements as our infrastructure scales to meet demand. Thank you for your patience as we work toward full resolution. Next Update: Within 30 minutes or when normal operation is restored.

  5. resolved Nov 17, 2025, 08:23 PM UTC

    This incident has been resolved. All resource classes including Linux, AMD, and Remote Docker are now operating normally with standard queue times. The additional capacity has been successfully deployed and job start delays have been eliminated. Thank you for your patience while our engineers worked through this issue.