Split incident

Hosted CI Builds Failing Intermittently

Major Resolved View vendor source →

Split experienced a major incident on May 27, 2026, lasting 13h 13m. The incident has been resolved; the full update timeline is below.

Started
May 27, 2026, 12:35 PM UTC
Resolved
May 28, 2026, 01:48 AM UTC
Duration
13h 13m
Detected by Pingoru
May 27, 2026, 12:35 PM UTC

Update timeline

  1. investigating May 27, 2026, 12:35 PM UTC

    We are currently investigating this issue.

  2. identified May 27, 2026, 01:43 PM UTC

    The issue has been identified and a fix is being implemented.

  3. identified May 27, 2026, 02:06 PM UTC

    We are continuing to work on a fix for this issue.

  4. identified May 27, 2026, 03:20 PM UTC

    Harness is continuing to investigate and implement changes to fully restore functionality. At this time, we are still seeing some CI Builds intermittently fail.

  5. identified May 27, 2026, 04:32 PM UTC

    Harness has implemented a change and are seeing failures reduced, but are continuing to work on completing mitigation. Customers can expect executions to succeed more frequently. Prod1/Prod2 are back to normal.

  6. identified May 27, 2026, 05:54 PM UTC

    Harness is currently implementing a failover as the issue has not yet been completely mitigated for some customers. Once failover has been completed, we will advise customers

  7. monitoring May 27, 2026, 11:53 PM UTC

    A fix has been implemented and we are monitoring the results.

  8. resolved May 28, 2026, 01:48 AM UTC

    This incident has been resolved.