Balena incident

Elevated Delta Errors

Resolved after 14 hours 28 minutes, affecting Delta Image Downloads, on February 10, 2026.

postmortem Feb 11, 2026, 12:10 AM UTC

v2 delta generation service experienced failures from ~21:15 UTC Feb 9 to ~10:00 UTC Feb 10, 2026, due to a missing configuration dependency during a logic change. **Impact:** * v2 delta generation requests failed to complete * No data loss or security impact **Root Cause:** Recent logic changes were deployed without the required accompanying configuration update, preventing the service from completing v2 delta requests. **Resolution:** The logic changes were rolled back, restoring the service to its previous stable state. **Follow-up Actions:** * Prepare and deploy the permanent fix We apologize for the disruption and any inconvenience this caused. We are committed to improving our processes to prevent similar issues in the future.

Started
Feb 10, 2026, 09:33 AM UTC
Resolved
Feb 11, 2026, 12:02 AM UTC
Duration
14h 28m
Detected by Pingoru
Feb 10, 2026, 09:33 AM UTC

Affected components

Delta Image Downloads

Update timeline

  1. investigating Feb 10, 2026, 09:33 AM UTC

    Some delta generation requests are encountering errors and failing. We are currently investigating this issue.

  2. monitoring Feb 10, 2026, 10:25 AM UTC

    We have identified the potential cause and have rolled back the changes.

  3. resolved Feb 11, 2026, 12:02 AM UTC

    This incident has been resolved.

  4. postmortem Feb 11, 2026, 12:10 AM UTC

    v2 delta generation service experienced failures from ~21:15 UTC Feb 9 to ~10:00 UTC Feb 10, 2026, due to a missing configuration dependency during a logic change. **Impact:** * v2 delta generation requests failed to complete * No data loss or security impact **Root Cause:** Recent logic changes were deployed without the required accompanying configuration update, preventing the service from completing v2 delta requests. **Resolution:** The logic changes were rolled back, restoring the service to its previous stable state. **Follow-up Actions:** * Prepare and deploy the permanent fix We apologize for the disruption and any inconvenience this caused. We are committed to improving our processes to prevent similar issues in the future.

Your product runs on more than Balena

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →