Ubicloud incident

GitHub Actions Incident

Major Resolved View vendor source →

Ubicloud experienced a major incident on September 12, 2024 affecting Ubicloud Runners, lasting 11h 11m. The incident has been resolved; the full update timeline is below.

Started
Sep 12, 2024, 12:38 PM UTC
Resolved
Sep 12, 2024, 11:50 PM UTC
Duration
11h 11m
Detected by Pingoru
Sep 12, 2024, 12:38 PM UTC

Affected components

Ubicloud Runners

Update timeline

  1. investigating Sep 12, 2024, 12:38 PM UTC

    Ubicloud runners are currently experiencing an outage, resulting in stalling job requests. We are investigating the incident.

  2. monitoring Sep 12, 2024, 05:39 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. monitoring Sep 12, 2024, 08:52 PM UTC

    We are continuing to respond to this incident. The intermittency is caused by abuse actors on the platform that we have to mitigate.

  4. monitoring Sep 12, 2024, 11:48 PM UTC

    As of now, we expect all GitHub Actions runners to work in a normal manner. If you notice anything out of place, such as a stuck runner, please write to [email protected], we'll be standing by to look at those in detail.

  5. resolved Sep 13, 2024, 02:30 PM UTC

    Incident has been resolved.