12Twenty experienced a major incident on March 4, 2022, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Mar 04, 2022, 05:46 AM UTC
A recent deployment stalled while executing database migrations, perhaps due to database deadlocks. Many requests to the database timed out during this time, leading to errors. Lower environments did not experience this; we are still investigating the cause of the issue. The increase in timeouts/errors lasted between 7:35pm PT and 8:15pm PT.