Chameleon.io experienced a major incident on February 3, 2025 affecting User profile API and Sidebar API and 1 more component, lasting 3h 31m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Feb 03, 2025, 11:13 AM UTC
We are seeing elevated error rates, and various systems being slow or not loading. At the moment this includes the Chameleon dashboard, identifying users, and sending data to Chameleon. We know this is related to the performance of our primary database and will have an update again shortly.
- monitoring Feb 03, 2025, 11:57 AM UTC
Response times and error rates are returning to normal and will continue to monitor. At this time, we know that a large increase in latency when writing to the database caused the latency of essentially all other operations to increase. We will leave this incident open until we're sure that the changes have a chance to full stabilize, the background jobs have processed, and the workload returns to normal levels/latencies.
- resolved Feb 03, 2025, 02:44 PM UTC
This incident has been resolved.
- postmortem Feb 11, 2025, 08:29 PM UTC
Post mortem available [here](https://status.chameleon.io/incidents/04c5y9b9d4xd)