Balena incident

Elevated Device SSH Errors

Minor Resolved View vendor source →

Balena experienced a minor incident on October 18, 2024 affecting Git and Cloudlink (VPN), lasting 47m. The incident has been resolved; the full update timeline is below.

Started
Oct 18, 2024, 08:57 PM UTC
Resolved
Oct 18, 2024, 09:45 PM UTC
Duration
47m
Detected by Pingoru
Oct 18, 2024, 08:57 PM UTC

Affected components

GitCloudlink (VPN)

Update timeline

  1. investigating Oct 18, 2024, 08:57 PM UTC

    We're experiencing an elevated level of device SSH errors and are currently looking into the issue.

  2. identified Oct 18, 2024, 09:07 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Oct 18, 2024, 09:08 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Oct 18, 2024, 09:20 PM UTC

    This incident has been resolved.

  5. postmortem Oct 18, 2024, 09:20 PM UTC

    There was a brief outage of remote SSH access to devices while we rotated some access keys in our cluster. Going forward we will adapt our process to avoid the downtime, or include it as part of planned maintenance windows.