System Errors

Update timeline

1. investigating Mar 10, 2026, 04:58 PM UTC

   We are currently experiencing an increase in system errors across our portals. We are investigating the issue and will provide more information soon.

2. identified Mar 10, 2026, 05:05 PM UTC

   We have identified the issue and implemented mitigation measures. Occurrences of system errors are declining as we continue to monitor.

3. monitoring Mar 10, 2026, 05:21 PM UTC

   A fix has been implemented and we are continuing to monitor the results.

4. resolved Mar 10, 2026, 05:28 PM UTC

   This incident has been resolved.

5. postmortem Mar 10, 2026, 06:11 PM UTC

   At 12:15 PM EST, an error with one of our background processes led to a rise in system errors across our portals. Our automated alert system brought this to our attention. At 12:50 PM EST, we restarted our receivers as a mitigation measure, which reduced the volume of system errors immediately. By 12:58 PM EST, a specific background process was identified as the root cause, and was fixed. Moving forward, continued improvements to our infrastructure and internal tooling will help us minimize occurrences of these types of errors. In the meantime, we will swiftly identify and resolve these errors in a similar fashion to today’s incident.