Grid AI incident

Degraded Performance on Sessions and Runs

Minor Resolved View vendor source →

Grid AI experienced a minor incident on August 3, 2021 affecting Grid Service, lasting 1h 45m. The incident has been resolved; the full update timeline is below.

Started
Aug 03, 2021, 01:18 PM UTC
Resolved
Aug 03, 2021, 03:03 PM UTC
Duration
1h 45m
Detected by Pingoru
Aug 03, 2021, 01:18 PM UTC

Affected components

Grid Service

Update timeline

  1. investigating Aug 03, 2021, 01:18 PM UTC

    An internal component is failing to add new nodes to the cluster node pools on Grid Cloud.

  2. identified Aug 03, 2021, 01:19 PM UTC

    We have identified the failing component. We are actively working on a solution. Another update will be issued in 1h.

  3. monitoring Aug 03, 2021, 02:11 PM UTC

    A fix has been applied. We are monitoring for additional errors.

  4. resolved Aug 03, 2021, 03:03 PM UTC

    This incident has been resolved.