Balena incident

Elevated Device SSH Errors

Resolved after 47 minutes, affecting Git and Cloudlink (VPN), on October 18, 2024.

postmortem Oct 18, 2024, 09:20 PM UTC

There was a brief outage of remote SSH access to devices while we rotated some access keys in our cluster. Going forward we will adapt our process to avoid the downtime, or include it as part of planned maintenance windows.

Started
Oct 18, 2024, 08:57 PM UTC
Resolved
Oct 18, 2024, 09:45 PM UTC
Duration
47m
Detected by Pingoru
Oct 18, 2024, 08:57 PM UTC

Affected components

GitCloudlink (VPN)

Update timeline

  1. investigating Oct 18, 2024, 08:57 PM UTC

    We're experiencing an elevated level of device SSH errors and are currently looking into the issue.

  2. identified Oct 18, 2024, 09:07 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Oct 18, 2024, 09:08 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Oct 18, 2024, 09:20 PM UTC

    This incident has been resolved.

  5. postmortem Oct 18, 2024, 09:20 PM UTC

    There was a brief outage of remote SSH access to devices while we rotated some access keys in our cluster. Going forward we will adapt our process to avoid the downtime, or include it as part of planned maintenance windows.

Your product runs on more than Balena

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →