Buildkite incident

Service degredation with flaky test detection

Minor Resolved View vendor source →

Buildkite experienced a minor incident on July 30, 2025 affecting Web and Ingestion, lasting 1h 41m. The incident has been resolved; the full update timeline is below.

Started
Jul 30, 2025, 09:29 AM UTC
Resolved
Jul 30, 2025, 11:10 AM UTC
Duration
1h 41m
Detected by Pingoru
Jul 30, 2025, 09:29 AM UTC

Affected components

WebIngestion

Update timeline

  1. investigating Jul 30, 2025, 09:29 AM UTC

    We are observing delays in processing flaky test detection and are currently investigating.

  2. monitoring Jul 30, 2025, 10:41 AM UTC

    We have identified and rectified the cause of this delay. The system is now working through the backlog of flaky test data.

  3. resolved Jul 30, 2025, 11:10 AM UTC

    Flaky test detection has returned to normal operation and processing is no longer delayed.