Chameleon.io incident
Chameleon application errors / performance
Chameleon.io experienced a minor incident on February 27, 2025 affecting User profile API and JavaScript CDN and 1 more component, lasting 1d 6h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Feb 27, 2025, 01:48 PM UTC
Chameleon continues to experience extremely high load and is taking steps to increase capacity above normal limits to address this. The current impact is that some requests to Chameleon are queued for a long time and/or timing out. In the UI this looks like page not loading, auto-saving not working, and for end-users experiences may not display. This currently appears to be happening for a < 10% of traffic but we'll continue to monitor as we work to resolve the issue
- monitoring Feb 27, 2025, 06:41 PM UTC
Our new capacity has been online for several hours now and is performing as expected. We will keep this incident open for another 24 hours in case of any new developments or issues. Thanks for out patience
- investigating Feb 28, 2025, 03:39 PM UTC
We are currently investigating slow downs and 503 errors on profile requests.
- monitoring Feb 28, 2025, 05:52 PM UTC
We are continuing to monitor system performance as response times and error rates have improved over the past hour. No new end-user-facing timeouts have been observed recently, but we are still actively investigating to ensure stability.
- resolved Feb 28, 2025, 07:55 PM UTC
This incident has been resolved, and all systems are operating as expected.