Buildkite experienced a major incident on January 31, 2026 affecting Web and Ingestion and 1 more component, lasting 1h 29m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 31, 2026, 10:06 AM UTC
A third party database provider is experiencing an outage which is resulting in Test Engine services being unavailable. We will report updates as we receive them.
- investigating Jan 31, 2026, 10:54 AM UTC
We have been notified by the third party provider that they are currently restoring services. We will update when we have more information.
- monitoring Jan 31, 2026, 11:15 AM UTC
Our third party database provider has recovered their systems and we are have worked through our backlog of test executions. We are continuing to monitor to ensure our systems are healthy.
- resolved Jan 31, 2026, 11:35 AM UTC
We believe this issue is now resolved and all Test Engine systems are functioning. Ingestion of test data was delayed during this incident but we believe there has been no data loss. Customers using Buildkite Test Engine Client (bktec) to run tests will have experienced slower builds during the incident due to bktec using a sub-optimal test planning strategy while Test Engine APIs were unavailable.