TRMNL experienced a major incident on July 10, 2025 affecting Screen Generation Workers, lasting 9h 44m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 10, 2025, 02:36 AM UTC
Google Calendar, Private Plugins, and Recipes leverage our Firefox browser pool, which is timing out during screen generation. Investigating.
- monitoring Jul 10, 2025, 11:44 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jul 10, 2025, 06:49 PM UTC
Incident resolved. On July 9 at 18:13 EDT we deployed major changes to the Framework design system. This included an asset deduplication strategy that created a bottleneck in our image generation pipeline for calendar plugins and private plugins. Within 30 minutes the issue was identified, and within 3 hours patched. Additional edge cases were discovered on July 10 between 06:00-10:10 EDT and also patched.