Benevity incident

Versaic performance degraded

Minor Resolved View vendor source →

Benevity experienced a minor incident on November 13, 2024 affecting Grants Advanced (formerly Versaic), lasting 2h 27m. The incident has been resolved; the full update timeline is below.

Started
Nov 13, 2024, 06:00 PM UTC
Resolved
Nov 13, 2024, 08:28 PM UTC
Duration
2h 27m
Detected by Pingoru
Nov 13, 2024, 06:00 PM UTC

Affected components

Grants Advanced (formerly Versaic)

Update timeline

  1. identified Nov 13, 2024, 06:00 PM UTC

    We identified an issue within the Versaic application for saving forms and are currently applying a fix.

  2. monitoring Nov 13, 2024, 07:03 PM UTC

    A fix has been implemented and we are now monitoring the results.

  3. resolved Nov 13, 2024, 08:28 PM UTC

    This incident has been resolved.

  4. postmortem May 05, 2025, 01:56 AM UTC

    ## Summary On Nov 13th, due to a code change related to Smart Expressions some of the Versaic clients were experiencing an issue where they were seeing an exception page after the preliminary question and were unable to submit any grant requests. ## Impact This issue was initially reported by one client. On further investigation it was determined that any submitter required to provide an access code were affected. The affected clients were unable to submit any grant requests since the forms on any of the proposals were not getting saved. ## Root Cause A code change related to Smart Expressions calculation was the root cause of the incident. We made a code update to improve how visibility conditions are checked when evaluating questions, helping to determine which questions should be visible or hidden. However, this change unintentionally caused some questions with invalid smart expressions to be evaluated. ## Future Mitigation Test the changes throughly for clients with similar configurations. ## Timeline of Events * Nov 13, 2024 8:10 AM MT - Initial alert received * Nov 13, 2024 10:40 AM MT - Issue identified and fixed; deployment in progress * Nov 13, 2024 11:50 AM MT - Deployment completed; Incident resolved; systems fully oprrational