Balena experienced a minor incident on September 25, 2024 affecting Application Builder, lasting 1h 55m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 25, 2024, 07:46 PM UTC
We're experiencing an elevated level of errors in our application builder infrastructure and are currently looking into the issue.
- identified Sep 25, 2024, 08:08 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Sep 25, 2024, 08:17 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Sep 25, 2024, 09:42 PM UTC
This incident has been resolved.
- postmortem Sep 25, 2024, 09:42 PM UTC
A token used for caching pulls from DockerHub expired on our cloud builders. This resulted pulls from DockerHub as appearing as unauthenticated \(even though the images were public\). We quickly generated a new token and updated the builder workers to use this token for the local registry caches.