Neon Fundraise incident
Degraded performance on Registrants grid
Neon Fundraise experienced a minor incident on November 20, 2023 affecting Management interfaces, lasting 19h 29m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 20, 2023, 10:45 PM UTC
This morning at around 7:20am Pacific, we received alerts that the Registrants grid (in the Admin, under People) was failing to load. After some research, we identified that the issue occurs specifically when sorting the grid ascending by Last Name, and that being the default sort configuration, it was failing for every load. As such, at 12:00pm Pacific, we deployed a hotfix that changes the default sort configuration to registration date, with newest first. That way, the grid doesn't fail every time it is loaded. Still, if an administrator manually changes the sort to Last Name ascending, the grid will fail in that instance. We are still investigating the root cause of the issue and will post an update when we have a fix.
- monitoring Nov 21, 2023, 02:36 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Nov 21, 2023, 06:15 PM UTC
We deployed some slight changes to the grid that has resolved the issue.