Percy experienced a minor incident on January 20, 2023 affecting Rendering infrastructure, lasting 52m. The incident has been resolved; the full update timeline is below.
Affected components
Rendering infrastructure
Update timeline
- investigating Jan 20, 2023, 02:13 PM UTC
We are currently investigating this issue.
- resolved Jan 20, 2023, 02:13 PM UTC
We identified an issue in our rendering infrastructure which caused our render jobs to pile up and builds to slow down from 3:50 AM PST to 4:42 AM PST. No builds failed during this time and we have recovered the job backlog completely now. We will be reviewing our internal processes to make sure this doesn't happen again.