Form.io experienced a notice incident on August 31, 2021 affecting Form.io API, lasting —. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- resolved Aug 31, 2021, 01:49 PM UTC
The issue has been resolved.
- postmortem Sep 07, 2021, 02:13 PM UTC
At approximately 7am, we started experiencing large volumes of authentication traffic. The problem was caused by a large volume of queries being created within our temp token api, which was creating many temporary auth tokens. Normally, these tokens expire after 60 minutes and are deleted, so it is rare that there are more than 100 outstanding temp tokens at a time. In this particular case, there were large volumes of temp tokens being created within a short amount of time that caused upwards of 1,000,000 temp tokens to be created. This caused an issue where lookups of temp tokens were taking a long amount of time. This was resolved by creating an index within this collection so that no matter how many tokens are created, it will be able to index them efficiently and not bog down the database resources.