Trustgrid Public incident

Nodes showing as disconnected

Resolved after 1 hour, affecting Cloud Controller, on February 21, 2025.

resolved Feb 21, 2025, 08:21 PM UTC

At this time we believe all nodes have corrected their control plane connection status. We have a fix for the issue that is causing the backend service to crash and it will be deployed to production in a cloud release early next week.

Started
Feb 21, 2025, 07:20 PM UTC
Resolved
Feb 21, 2025, 08:21 PM UTC
Duration
1h
Detected by Pingoru
Feb 21, 2025, 07:20 PM UTC

Affected components

Cloud Controller

Update timeline

  1. investigating Feb 21, 2025, 07:20 PM UTC

    We are seeing a large number of disconnected nodes which seems similar to the event on February 14th. We are actively investigating the issue.

  2. monitoring Feb 21, 2025, 07:27 PM UTC

    The issue appears to have resolved. We have confirmed the same control plane service had an issue as on February 14 and we are confirming the same root cause. For clarification, there is no indication that this impacting data plane traffic. Only connectivity to the Trustgrid control plane.

  3. monitoring Feb 21, 2025, 07:44 PM UTC

    We are still seeing a large number of nodes showing disconnected after the control plane service stablized. We are taking steps to attempt to resolve this.

  4. resolved Feb 21, 2025, 08:21 PM UTC

    At this time we believe all nodes have corrected their control plane connection status. We have a fix for the issue that is causing the backend service to crash and it will be deployed to production in a cloud release early next week.

Your product runs on more than Trustgrid Public

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →